This is just some napkin math, but it concerns me. I hadn't opened my QT wallet to sync for about 2 weeks and when I opened it today it was syncing incredibly slowly. I timed how many blocks were processed in a minute and got about 10 blocks per minute on a Friday morning at 8:00. Theoretically, this shouldn't be a very popular time to make bitcoin transactions. Still, the blocks that I my wallet was able to process in that time were of the following sizes:
320306: 340 kb
320307: 730 kb
320308: 10 kb
320309: 263 kb
320310: 230 kb
320311: 100 kb
320312: 221 kb
320313: 26 kb
320314: 225 kb
320315: 700 kb
Total: 2.845 MB
So my computer (a newer macbook pro retina) could process ~2.8 MB worth of transactions in a minute. Or rather, on average, ((2845 kb)/(.5 kb per tx))/(10 blocks *7.5 min/block *60 sec/min) ~= 1.25 TXs per second. And if there are more transactions on the network then we can expect even fewer blocks per minute to be processed. I suppose that theoretically the network should be fine as long as it doesn't take more to validate than it does to solve a block (expected 10 min, more like 7.5 minutes in reality). But even if the 1MB block size restriction were removed, it seems like we could get to the point someday where lone computers couldn't keep up with the transactions in the network.
According to this:
https://en.bitcoin.it/wiki/Scalability, VISA handles about 2000 TPS on average. If 1.25TPS ~= 6 seconds/block download and verification, then 2,000 TPS gives ~1.5 hours to download and verify a block. BASIC COMPUTERS WILL NOT BE ABLE TO VERIFY TRANSACTIONS AND THE WHOLE SYSTEM WILL FAIL TO BE DECENTRALIZED.
It seems that bitcoin may be punished by its own success. Yes, this doesn't take into account Moore's law, and it's just napkin math, but it's still concerning.
TL;DR: If bitcoin becomes adopted, then it may have to become centralized. At least more centralized than it is now. But at least it will be open and auditable by multiple companies, and no one can just create bitcoin out of thin air.