I've put up a customized version of SystemRescueCD 4.1.0 here:

https://dl.dropboxusercontent.com/u/57535575/bitcoin-sysresccd.iso

Some of what I've added to the image:

• Firefox
• bitcoind and bitcoin-qt 9.0
• Armory 0.90
• bfgminer (with support for most currently-available FPGA and ASIC miners...only one I left out was bfsb since that only runs on a Raspberry Pi)
• CUPS and HPLIP
• git

The main changes since the previous release (based on v3.7.0) are replacing cgminer with bfgminer and adding Armory.

If you install to a USB flashstick and add backing store, I suspect you could set up a diskless FPGA or ASIC miner with this.  With Firefox and printing support, you should also be able to create paper wallets and do other stuff you might want to do on an offline system.  All of the tools that come with SystemRescueCD are still in there, too.  If you add a copy of the Portage tree, you can even customize your system further (just make sure your backing store is large enough).