I think this is just FUD, if it's taken down from SF it will be hosted somewhere else, and if hosting the bitcoin client binaries becomes problematic I think it'll mean the bitcoin community will have much bigger problems to solve at that point than sharing some binary.
Also people who seek the next, next, next experience will probably have no problem simply using an e-wallet.
So, I'll take for granted that you read and understand 100% of the source code every time you compile it... I would like to read your reports about those source audits if that's what you do.
It seems a little exaggerated fear to me...
Fear? What about doing the right thing? Let everybody have access to Bitcoin, and not only whoever is not on the Forbidden Persons list?