84 Gigabytes Per Month, Per Connection

[benjamindees]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

If you want any redundancy at all, as a true peer-to-peer network should, for whatever reason at all (resiliency, privacy, etc), you need to start adding on redundant pathways, and more data.

All of that has to fit within the data caps imposed by your internet service provider, along with all of your other internet usage -- all of the Youtube videos, other P2P programs, NetFlix, etc, for everyone who uses your connection.  In the US, the vast majority of home internet connections are limited to less than 400 gigabytes per month, most less than 250 gigabytes.

These caps are independent of your connection speed.  They are arbitrarily imposed by internet service providers.  They may grow with technological advancements, or they may not.

Other, developing parts of the world have to deal with other limitations.  Only in a few, highly-developed regions, are home internet connections both high speed and un-capped.

In response to this, there will be some hand-waving arguments involving splitting up blocks into transactions and getting each transaction from a different peer.  And that's great.  That's certainly an improvement over the current network.  But please understand all of the trade-offs involved.  There are trade-offs.

[futureofbitcoin]

Let me get this straight. I'm not technical at all, and I didn't really read any of the previous arguments on this topic. But just from the OP (and some common sense), this is what I gather:

So the trade off is either to make bitcoin unscalable, which obviously means it can't go mainstream, and will probably die off.

OR

Having a few less people/companies with a full copy of the blockchain, though there will probably still be many, many, many companies, mining operators, and individuals in more developed parts who will keep this "redundancy".

Is that correct?

[virtualx]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

I would add to this that a lot of people do not run bitcoin nodes and instead rely on light wallets.
Perhaps scaling bitcoin with sidechains is a better idea  

[Meuh6879]

in most europa, up and down are unlimited in volume.
but speed ... 5-10 MBit/s in download ... and less than 1MBit/s in upload.

so, yes ... bitcoin blockchain with blocks limited to 20Mb can be a problem ... for private nodes.
maybe satoshi have right to say "when the time comes, only professionnals nodes can efficiently provides bitcoin network with blockchain data"

professionnal node = 1GBit/s ... synchronised (UP and DOWN).

[btbrae]

The people that need the data have the data.

Businesses become nodes and supernodes etc for example...

Blockchain -> Coinbase -> Business -> Customer

Is it working fine this way.

[NeuroticFish]

Each client gets the chain from a couple random others.
Trying to imply that one comp having the chain wil keep sharing it all is silly.

Coming from a Legendary account... is this bought, or you think that some nicely packed trolling will affect the market?

[canth]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

Gavin's proposal doesn't have 20MB blocks begin until Mar 1 2016. Even after that date, it's incredibly unlikely that we'll have 20MB blocks until several years afterward. Bitcoin will need more bandwidth in the future, not less - luckily technology doesn't stand still and the cost of moving lots of data will come down and be available to many more citizens around the world.

Just like the needs for streaming HD movies will go from 1080 to 4K over the next few years, so too will the hardware requirements for bitcoin. Don't worry - there will be plenty of people to run nodes.

[SpanishSoldier]

I think, in future, people wont need to download the complete blockchain anymore to run Bitcoin QT. This is probably already available for some wallets. Downloading the complete blockchain will probably become optional or people will get that through torrent.

[Klestin]

I was going to buy a two ton pickup, but who wants to drive around all day every day with two tons of crap in the bed?  It's just not practical.  So, I bought a scooter instead.  If I ever need to carry something heavy, I'm boned.  But at least I don't have to carry two tons of gravel with me when I go to the grocery store.

Have I correctly captured op's logic?

[inBitweTrust]

in most europa, up and down are unlimited in volume.
but speed ... 5-10 MBit/s in download ... and less than 1MBit/s in upload.

so, yes ... bitcoin blockchain with blocks limited to 20Mb can be a problem ... for private nodes.
maybe satoshi have right to say "when the time comes, only professionnals nodes can efficiently provides bitcoin network with blockchain data"

professionnal node = 1GBit/s ... synchronised (UP and DOWN).

I am showing much higher averages in europe -
http://explorer.netindex.com/maps

Check for yourself.

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

We understand the tradeoffs... Aren't you being somewhat of an alarmist and misleading by only discussing 20MBs? Don't you expect to see the exact same blocksize after the hardfork with an occasional 2MB block? When do you assume we will be pegged at 20 MB blocks? Why are most blocks only 30-40% full now when the limit is higher?
----------------------------------------------------------------------------
Everyone needs to read Mike Hearns recent article on why the blocksize limit needs to increase -

https://medium.com/@octskyward/the-capacity-cliff-586d1bf7715e

The lightning network and other solutions aren't going to be ready for at least 2 years.

Additionally, keep in mind Merkle tree pruning is going to be released in 0.11 as well allowing for full pruned nodes at 1 GB in size.

https://github.com/bitcoin/bitcoin/commit/f9ec3f0fadb11ee9889af977e16915f5d6e01944#diff-c865a8939105e6350a50af02766291b7R1182

https://www.reddit.com/r/Bitcoin/comments/33oz97/just_merged_pruning_support_in_bitcoin_core_run_a/

[dasource]

Am I the only one who is starting to get sick of this?
Really? we are all going to wake up one day and every block is going to be 20MB? when will you get it? there needs to be transactions to fill up a block; it is not going to magically happen ...

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

No it is not; that is not how P2P works ... a single peer does not send all the blocks to another peer, it is shared. Please stop spreading nonsense and dooms day theories on a block size increase.

Quite frankly someone needs to grab the bull by the horn and make the decision and pull into the bitcoin core (and I am sure Gavin will).

[achow101_alt]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

There is only one time that one node has to upload or download all of the blockchain, and that is when a new full node comes online. It downloads the blockchain from one other node, and that is its only full blockchain download. If you don't want to be the node that has to upload the full blockchain, you can change that in your config file. The full blockchain download is definitely under the monthly caps. Those 84 gigabytes happens only once in the nodes lifetime, and the blockchain won't be 84 gigs even when 20 MB blocks are accepted. The 20 MB blocks just mean that the maximum block size accepted by the network is 20 MB, not that every block is 20 MB. Get your facts straight.

[Jammalan the Prophet]

Am I the only one who is starting to get sick of this?
Really? we are all going to wake up one day and every block is going to be 20MB? when will you get it? there needs to be transactions to fill up a block; it is not going to magically happen ...

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

No it is not; that is not how P2P works ... a single peer does not send all the blocks to another peer, it is shared. Please stop spreading nonsense and dooms day theories on a block size increase.

Quite frankly someone needs to grab the bull by the horn and make the decision and pull into the bitcoin core (and I am sure Gavin will).

And how does the mighty P2P work?
If 100 people want to download 1 gb of data , there have to be people uploading 100 gb of data.
And now it's only a question who will do the upload , 1000 people or 10 people.

If you pick 10 it means 10 people supplying 10x more people.

But be careful , if you pick the 1000 choice it means that 1000 people already have that data , how did they get it?
=)))))

In the end it's a 1:1 ration , with some peers uploading 50x times more than they download and peers not uploading anything.

As a sidenote
A reddit post one year ago tried to raise an alarm
http://www.reddit.com/r/Bitcoin/comments/24645i/psa_the_amount_of_full_bitcoin_nodes_is_dropping/

Of course , people said it was FUD.
But since then the number of nodes dropped from 7400 to 5800
https://getaddr.bitnodes.io/dashboard/?days=90

Was it FUD?

[vpitcher07]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

There is only one time that one node has to upload or download all of the blockchain, and that is when a new full node comes online. It downloads the blockchain from one other node, and that is its only full blockchain download. If you don't want to be the node that has to upload the full blockchain, you can change that in your config file. The full blockchain download is definitely under the monthly caps. Those 84 gigabytes happens only once in the nodes lifetime, and the blockchain won't be 84 gigs even when 20 MB blocks are accepted. The 20 MB blocks just mean that the maximum block size accepted by the network is 20 MB, not that every block is 20 MB. Get your facts straight.

I was about to ask the same thing but you answered my question. I don't understand why everyone is freaking out over 20MB blocks as if it's going to happen right when this is implemented. Look at the last blocks mined on blockchain.info. None of them are even 1MB yet (most of them not even close). So unless I'm missing something, I really don't understand the bandwidth/storage argument against this.

[Jammalan the Prophet]

That's what 20 MB blocks require.  That means, you receive the blockchain, that's 84 gigabytes per month.  You send the blockchain to one peer, that's another 84 gigabytes per month.

There is only one time that one node has to upload or download all of the blockchain, and that is when a new full node comes online. It downloads the blockchain from one other node, and that is its only full blockchain download. If you don't want to be the node that has to upload the full blockchain, you can change that in your config file. The full blockchain download is definitely under the monthly caps. Those 84 gigabytes happens only once in the nodes lifetime, and the blockchain won't be 84 gigs even when 20 MB blocks are accepted. The 20 MB blocks just mean that the maximum block size accepted by the network is 20 MB, not that every block is 20 MB. Get your facts straight.

I was about to ask the same thing but you answered my question. I don't understand why everyone is freaking out over 20MB blocks as if it's going to happen right when this is implemented. Look at the last blocks mined on blockchain.info. None of them are even 1MB yet (most of them not even close). So unless I'm missing something, I really don't understand the bandwidth/storage argument against this.

Looking at another chart :
https://blockchain.info/en/charts/n-transactions-excluding-chains-longer-than-10?showDataPoints=false&timespan=&show_header=true&daysAverageString=7&scale=0&address=

Seems like there are only 30k real transactions per day in bitcoinland.
Let's assume 1 pf every 100 McDonalds customers would pay in bitcoin....

Care to tell me what would be the size of the blocks?

[ticoti]

The limit is 20 mb doesn't mean that every block is going to be 20 mb, I think we won't see 20 mb blocks in a long time after the hard fork

[achow101_alt]

Looking at another chart :
https://blockchain.info/en/charts/n-transactions-excluding-chains-longer-than-10?showDataPoints=false&timespan=&show_header=true&daysAverageString=7&scale=0&address=

Seems like there are only 30k real transactions per day in bitcoinland.
Let's assume 1 pf every 100 McDonalds customers would pay in bitcoin....

Care to tell me what would be the size of the blocks?

McDonalds serves about 69 million customers per day, according to their company profile

If one out of every 100 customers paid with bitcoin: 69000000 / 100 = 690000 transactions per day
Assuming that the transactions are spread equally throughout the day: 690000 / 144 = 4791.667 ~ 4792 transactions per block
Assuming that the transactions are standard and the average transaction size is 250 bytes (0.25 KB): 4792*.25 = 1198 KB in transactions
Adding this extra size to average block size: 1.198 + 0.5 = 1.698 MB.

The block size would then be about 1.698 MB, not that much larger than the current maximum, and most certainly not up to 20 MB. Even with that many transactions, it still would not take up a lot of bandwidth, but eventually, over time, like the current blockchain, these transactions will cause the blockchain to grow in size, but it is already doing that.

*Note: these numbers are both rounded up and chosen from the highest numbers on blockchain.info's charts for the past year.

[Jammalan the Prophet]

Looking at another chart :
https://blockchain.info/en/charts/n-transactions-excluding-chains-longer-than-10?showDataPoints=false&timespan=&show_header=true&daysAverageString=7&scale=0&address=

Seems like there are only 30k real transactions per day in bitcoinland.
Let's assume 1 pf every 100 McDonalds customers would pay in bitcoin....

Care to tell me what would be the size of the blocks?

McDonalds serves about 69 million customers per day, according to their company profile

If one out of every 100 customers paid with bitcoin: 69000000 / 100 = 690000 transactions per day
Assuming that the transactions are spread equally throughout the day: 690000 / 144 = 4791.667 ~ 4792 transactions per block
Assuming that the transactions are standard and the average transaction size is 250 bytes (0.25 KB): 4792*.25 = 1198 KB in transactions
Adding this extra size to average block size: 1.198 + 0.5 = 1.698 MB.

The block size would then be about 1.698 MB, not that much larger than the current maximum, and most certainly not up to 20 MB. Even with that many transactions, it still would not take up a lot of bandwidth, but eventually, over time, like the current blockchain, these transactions will cause the blockchain to grow in size, but it is already doing that.

*Note: these numbers are both rounded up and chosen from the highest numbers on blockchain.info's charts for the past year.

And double that.
Because the customer pays to random generated address , then seller has to collect all coins in one place.

While it might look small , it will be enough for a lot of miners to exclude a lot of transactions just to have their solved block accepted first and a lot of miners would not even think of including 4MB of transactions in one block.

We are seeing this already with the transaction pool running in thousands and miners adding only <100 in their solved block.

[futureofbitcoin]

@^

Can you explain the details of why miners might not want to include transactions? Does it make it harder to solve a block? Or something else?

Either way, when the block rewards lower significantly, at that time, miners will be forced to accept more transactions, no?

[achow101_alt]

And double that.
Because the customer pays to random generated address , then seller has to collect all coins in one place.

While it might look small , it will be enough for a lot of miners to exclude a lot of transactions just to have their solved block accepted first and a lot of miners would not even think of including 4MB of transactions in one block.

Actually, it would not have to be double that, they could all send the bitcoin to the same address. Or, once a day, one large transaction is created which consolidates all of the bitcoin in one address. There would only be a massive transaction fee for including so many inputs. Double the transactions is not necessary.

We are seeing this already with the transaction pool running in thousands and miners adding only <100 in their solved block.

Where are we seeing this? I don't see anywhere where miners are dropping transactions because there are too many. I see them dropping transactions for low or no fees. Miners are definitely not adding less than 100 transactions in a block. In fact, there are between 500 and 900 transactions per block on average. I don't know where you are getting that number, but I suggest you do some research before posting.