I read through the forum and noticed at least two other users asking the same question

http://bitcointalk.org/index.php?topic=743.msg8208#msg8208
http://bitcointalk.org/index.php?topic=101.msg1134#msg1134

Does anyone know if there exists an "issue tracking" system for the Bitcoin software?

It would be nice to have a place where users can request features or report bugs

yeah that makes sense, and I can see why the "delete" feature is not present by default.

what about hiding the button by default, and allowing it to be activated by setting a certain field in the options?
when a user activates the delete button they will get a warning, which basically tells them what you just wrote here.

that way there is a way to clean up unused addresses for cases such as this.
for example, I have never used any of my unwanted addresses, nor have I informed anyone of them.

what do you think?

There is no urgency to delete it.
But, there is also no reason to keep it... and it's kind of "ugly" having junk data in the application

Are there any plans to update the GUI to provide the "delete" functionality?

Or is this more of a system problem? I.e. a user may delete their address before some "money" transfer has reached them, so deliver guarantees can only be provided if addresses are never deleted?

While getting familiar with the Bitcoin UI I created an extra "Receiving Address" but now I'd like to delete it.

Is there a way to do so?