arent many clients opensource? So what would the worry be? If most people are using the official client then your concerns shouldnt be valid I would think.
I'm not talking about a deliberately trojaned client. I'm talking about a defect in the software that allows remote control to be taken by an attacker. Such bugs are discovered from time to time in most network programs. Google for "X remote vulnerability" where X is openssh, apache, sendmail, bind, or whatever. Ask a professional sysadmin, and they will tell you that the bitcoin software would be very unusual indeed if it were exempt from such bugs.