Replace Microsoft Windows with GNU/Linux.
I recommend Tails, then make sure to dedicate the sole purpose of that machine to your wallet and NOTHING else.
Tails is excellent. It does all connections through Tor unless you click on the clearnet browser (correct me if I'm wrong) and great for accessing an electrum wallet using just your seed written down on paper. It even wipes your RAM on shutdown so that no trace of your transactions can be recovered. Every time you boot it starts from scratch (no wallet.dat file or any history left lurking) and doesn't touch your hard disk unless you tell it to through the file manager. It has everything you need for a quick online transmission to the Blockchain and then reboot without a trace.
It gets updated regularly (about once a month) to ensure any security flaws are dealt with and there's a BTC donation address on their home page. If you have a spare $20 worth of BTC to donate I'd recommend you sent them some BTC to keep this gem of an OS going. I've donated in the past and will do again.
It's a little bit slow booting from USB but worth it. Better still, install it on a lockable SD card and flick the switch to 'lock' mode so that you're doubly sure that nothing is altered. Then when a new version comes out unlock your SD and install it before locking it again. Sweet!