Thanks for the guidance Jim.
The "Uninstall" file in my Home>multibit-hd folder does not uninstall Multibit-HD on my Ubuntu 14.04 PC. It just opens up a text file in gedit.
I have now deleted both the hidden and non-hidden Multibit-HD folders. Unfortunately, I am still left with Multibit HD appearing in the Ubuntu Dash screen.
You can just rightclick on an icon on the menu and select "unlock from launcher" to have it removed. Its just a shortcut and should no longer work anyway.