Your power supply is likely toast, highly under-spec on the output. It works till you try to hit the TDP of the card, voltage sags and it goes unstable and crashes.
If you mean to say 800 watts is not enough for that system then I disagree.
I mean to say that a 800W "XtremeGear" power supply is nowhere near 800W, or probably even half that. If you knew how to read you would have picked that out of my earlier post.
Don't have to believe me though, just google "XtremeGear."