GPG is an identity mechanism, and is tied to your email. Bitcoin addresses are all anonymous, and aren't really easy to pin point to a straight forward id.
You don't email to use GPG, and you can be anonymous. Technically both Bitcoin and GPG are pseudonymous.
It would be cool if GPG would implement some things from Bitcoin: Instead of hex, encode the hash (fingerprint) into Base58/62. Support for ECDSA/ECDH (or something similar to go with ECDSA). Include public key in signature.