Remember that if you are using an offline wallet (paper-wallet or USB-stored wallet.dat file), there is no way to recover them in case the backup is lost or stolen. So it will be better to make 2 or 3 physical backups, and store them in safe and secure locations.
True. And you can also apply encryption on paper wallet with BIP0038.