Thanks for the responses. I will look into GUIminer. Hopefully the bitcoin client will support GPU mining in future official versions.
It does, it just doesn't contain the code to do the actual mining. You can use any mining program you like. I know of no mining program that doesn't support solo mining with the bitcoin client. The bitcoin client just doesn't contain the actual code to do the mining.