They keep track of it, but you can withdraw it at any time.
True. However I suggest you keep your BitCoins with you.
Search this forum for ideals on how to secure your BitCoins (i.e., your BitCoin wallet).
Then decide how you want to do it and post your plan. People may be able to find some holes.
One of the first places to check out is at
https://en.bitcoin.it/wiki/Securing_your_wallet