I think its the average Joe that is mainly panic selling and the big boys are just buying more and more.
If you study the charts, the recent panic selling was started by big holders. Thousands of bitcoins were dumped in a matter of minutes after the Mt.Gox announcement. The average small time BTC holder most likely did not even know about it at the time and dumping was actually instigated by whale type of holders.