While CPU speed is not really important for BTC mining, if you bog down your CPU you will get more stales and slower submit rates for your shares. It will cut into your BTC profits. Trust me, I tried on 2 rigs I let run for 1 month and my U went down.
I doubt your CPU M/Hs is worth the possilble damage to GPU hashing/productivity over time - so what DrG said