It really isn't that bad. As long as you don't cash out, there is nothing to worry about - as far as I know.
The problem with the IRS regulations is that it prevents other people from adapting BTC.
If you do not own/use BTC as of now and would have to keep records of how much you pay for BTC and the value of goods/services that you buy with BTC and pay taxes on any gains (and take a deduction on any losses) then you have little incentive to use Bitcoin.
The more people that use Bitcoin, generally the higher the long term price will be.