Bitcoin is about wealth and money. One needs to be able to confirm that one doesn't receive a version of Bitcoin that has been maliciously modified. It would therefor be a good idea to sign the source code as well as the binary packages. This way one just needs to be sure that one gets the right public key once.
The source is signed too— it's included as part of the Linux 'binary' packages.