Thanks for the suggestions. Personally I don't mind the trouble as long I will find a simple and secure solution for this. I would like to hear other people's opinions as well.
I'm still not sure you are getting what he is driving at.
My Linux setup with Bitcoin-QT installed created a .bitcoin folder inside my home folder. It's current size (bitcoin-qt is running and current) is 9.4 GB.
Of that, the wallet.dat is only 92 KB in size. The rest is the blockchain data. And considering how slow the blockchain can be to download (took me a week to get all of it the first time, shut the client down for a couple days once and took a few hours to get back up to date), you really don't want to mess with that through a USB drive or in something that isn't frequently updated. USB drives are generally too slow for this kind of stuff, and you would need a rather large drive to hold it since the blockchain is only going to get larger.
What might work better would be to use one of the light-weight clients that are available instead. They don't need the whole blockchain to function and would be more suited to what you want to do (just put the bare minimum necessary files on a USB and run it from there). You could even make the USB itself bootable and load up a minimal Linux with your client already installed in it, no need for CDs or anything else.
Or you could set up Armory, like was suggested. Though not sure it can be run off a CD like you wanted to.