Choose one wallet and stick to it except if a change that you don't like appears.
Bitcoin core- For developers and people who care about security as bitcoin core verifies the entire block. It does take more space though.
SPV clients (MultiBit/Electrum)- For normal users, SPV client is usually enough and is ideal for people with smallish storage space. The security is not to the standards of Bitcoin core though.
What do you mean "The security is not to the standards of Bitcoin core though." ?
For one thing the core wallet downloads the entire blockchain. So you have to continually update if you use it. Other wallets like MultiBit/Electrum do not require this, they are "lightweight clients" I believe the term is.
Also one thing to consider is paper wallet is cold. I really like cold wallets personally. You can always import a paper wallet into a wallet with private key or QR. So you don't have to have a software option. Also hardware wallets have really came a long way.