It doesn't seem like it should be that hard to debug python the to find where the cpu peg is happening.  Even if it's not poclbm's fault it would still be good to know on which opencl calls this happens.  I don't know opencl or bitcoin otherwise I'd dive in.