I have similar issues, plus I'm getting a lot more rejects than I would expect to see. For instance, here's what the output after a long session on BTC Guild:
[329.27 Mhash/sec] [5894 Accepted] [203 Rejected] [RPC (+LP)]
I've heard good things about Phoenix r64, in that it didn't have these problems, but no matter what I do, I can't seem to get it to connect to BTC Guild or Deepbit; it just gives me "[10/06/2011 15:21:31] Failed to connect, retrying..." error messages. Infuriatingly, it does work on Eligius and local bitcoind, so I have no clue what might be wrong.
are you using the correct parameters to connect?