Bitcoin blockchain sync very slow on HDD

[broflof]

I'm syncing my Bitcoin wallet blockchain using latest Bitcoin Core on Linux.

It progresses very very slowly, right now 2 to 3 weeks in 12 hours.

CPU and net usage stay low most of the time, problem is not there (most likely). HDD usage is constant, I think that's probably the bottleneck. It's a 7200rpm standard desktop HDD.

10 years ago I could sync the blockchain on a slow 5400rpm laptop HDD without major issues.

Time to buy big SSD perhaps.

But the interesting question is,
Does syncing get harder over time as the blockchain gets longer?

Or has something happened to the protocol so it would be harder now?

Or has the code quality of Bitcoin Core gone down?


The GUI also stalls badly during sync. I don't remember when this problem began but it did not always exist.

Syncing monero is also extremely slow and it has been so as long as I can remember.  But that's another story.

[promise444c5]

In the last 10 years there're fewer transactions in a block... now there's  more.
Use the current version check the latest news section  of the forum for the torrent file,
Then if you are using bitcoin-qt GUI  check the dbcache increase it, it could make it sync process more  faster(note the value is in MB ) this should  be done carefully  in accordance  to your  ram  capacity .

Does syncing get harder over time as the blockchain gets longer?

Not really but yes and might depends on the hardware , people can still get it done in just 2~4 days.

The GUI also stalls badly during sync. I don't remember when this problem began but it did not always exist.

Sometimes when when block index is writing to disk you might experience  that and you would think it's just stall

[un_rank]

Does syncing get harder over time as the blockchain gets longer?

Or has something happened to the protocol so it would be harder now?

It should, but the chain is not increasing as such a rate that will cause an significant lag in download time. Could be from the internet connection.

Nothing happened on the protocol level to make it harder either.

- Jay -

[LoyceV]

CPU and net usage stay low most of the time, problem is not there (most likely). HDD usage is constant, I think that's probably the bottleneck. It's a 7200rpm standard desktop HDD.

You have 2 bottlenecks: RAM, and HDD speed. Both are more or less interchangeable: with 32 GB RAM and 12000 MB dbcache, your sync will go just fine. With 8 GB RAM and an SSD, the SSD is still the bottleneck. I tested both of these examples myself.

10 years ago I could sync the blockchain on a slow 5400rpm laptop HDD without major issues.

Ten years ago, the entire blockchain was only 20 GB.

Does syncing get harder over time as the blockchain gets longer?

Yes. The chainstate directory keeps growing, and requires more and more RAM (or a LOT of disk activity) to verify the download.

Or has the code quality of Bitcoin Core gone down?

Nope. Older versions were much slower to sync.

Syncing monero is also extremely slow and it has been so as long as I can remember.  But that's another story.

Monero is even more demanding than Bitcoin Core, despite a much smaller blockchain.

TL;DR: get an SSD.
If you have a small SSD, put the chainstate directory on it. That will make a huge difference for Bitcoin Core. If you don't have an SSD yet, buy one. Get a decent one for best performance. It's going to largely improve your entire computing experience.

[philipma1957]

a decent i5 gen cpu say i5 8500 or newer
a 1 tb samsung ssd or bigger
16gb ram or more
a decent internet connection say 100Mbps or more


if you have all of the above you will be under 1 day


obvious that

an i7 14700
a 2tb nvme2 quality ssd
64gb ram
and a 1Gbps internet

will be faster.

In fact the second setup may be faster than the offered download speed.

I have used 200Mbps and
128gb ram
1tb nvme2 ssd
threadripper cpu

My setup was able to do 190Mbps constantly which makes me suspect my internet connection was my bottle neck

I will soon get 1gb internet and try to see how fast I can do this.

[ABCbits]

Does syncing get harder over time as the blockchain gets longer?

Short answer, yes. Not only each block become bigger, total UTXO keep growing.

Edit: I assume "gets longer" refers to newer blocks.

Or has something happened to the protocol so it would be harder now?

AFAIK no. New stuff (such as SegWit) solve few problem including quadratic verification time.

Or has the code quality of Bitcoin Core gone down?

No. Jameson Lopp did benchmark which prove the opposite on https://blog.lopp.net/bitcoin-core-performance-evolution/.

The GUI also stalls badly during sync. I don't remember when this problem began but it did not always exist.

That's true, it's known issue for few years. See this issue, https://github.com/bitcoin-core/gui/issues/299.