I would definitely not stop there, use custom OS's for it and you will definitely save yourself a headaches. I suggest Minera for these.
Looking at the Minera webpage right now. (I've heard of it before but never used)
Very cool that they have a Raspberry PI image.
Would be very interested to see how running the image compares in performance to running it on top of a already installed Linux OS.
Second time today I'm looking at things that have to do with Raspberry Pi. Maybe its time to finally buy one...