AFAIK there are 2 open databases of orphan blocks,
https://www.biteasy.com/ and
https://blockchain.info/ . However, they don't have data before 2014. Also, it seems blockchain.info reports more orphan blocks than biteasy.com but I haven't matched the results.
I wonder if anyone is keeping a database of all orphan blocks. I know it is not easy to define "orphan blocks" because it is trivial to fork the chain when the difficulty was low.
I'm particularly interested in those "buggy forks", e.g. the negative value output in 2010 and the v0.8 fork in 2013, and forks with double spending. (I thought there was also a fork related to P2SH in 2012 but I'm not sure. I learnt bitcoin after BIP16 was done)