I'm fairly sure that you do.
Somehow the client needs to scan the blockchain for transactions to addresses that you know the private key of.
You can also extract the private keys and import them in a hybrid client (blockchain.info) or a lightweight client (electrum).
bitcoind dumpprivkey publicaddr