So the OCD in me is just going to have to suffer then..
Or use a different bitcoin client.
Bitcoin-Qt does not allow you to choose where the change goes in your transactions. It just creates a new address and hides it in your wallet.dat. I think there are other bitcoin clients that will allow you to choose a change address. I can't remember which ones. Maybe Electrum? or
https://blockchain.info/wallet ?