If your wallet.dat file is stolen, you may still have access to your coins if you already have set a passphrase. If you don't set one, you will lose everything.
This is true, so you must develop the habit of setting a password for your wallet, which is the last line of defense to protect your assets.