You can generate an address offline and send funds there.
Or can have a paper wallet. just print it and keep it safe somewhere. You can keep sending Bitcoins to this address without even trying to open the wallet and check your balance repeatedly.
You can keep the private key safe, do not enter it anywhere (that is don't import it). It would be untouched, offline, and uncompromised unless and until you expose it to someone or import it to the wallet. This way you can have added security. All you have to take care of is the paper that you printed on. Try not to forget about its fading ink, print more copies if needed but don't store them in one place together.
I think there is no other way you can be safe. Plus, having limited storage methods makes it more uncomplicated and easy to use. The more the way the more user gets confused as well.