Bitcoin Forum
May 01, 2024, 09:57:21 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 [2]  All
  Print  
Author Topic: Bitcoin Core IBD slow  (Read 220 times)
apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 03, 2023, 08:44:47 AM
 #21


To sum up:
The IBD went from 0 to 790,000 in 5 days, then from 790,000 to 810,000 in 3 days, then from 810,000 to 814,000 in 2 days and currently, from 814,000 to 816,000 in 10 hrs. I guess it will reach 819,000 soon enough.

Thank you all for the answers, apparently it was what Loyce said above regarding the ordinals and the larger transactions.

Now, I am at 816,000 and it moves quickly. It must be finished later during the day.

Finally, I did increase my dbcache to 6000 (from a total of 8GB RAM), as all of you suggested. However, I did not use the assumevalid directive, because I wanted to read more about it before using it, but unfortunately I didn't have the time.


Bitcoin addresses contain a checksum, so it is very unlikely that mistyping an address will cause you to lose money.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1714557441
Hero Member
*
Offline Offline

Posts: 1714557441

View Profile Personal Message (Offline)

Ignore
1714557441
Reply with quote  #2

1714557441
Report to moderator
1714557441
Hero Member
*
Offline Offline

Posts: 1714557441

View Profile Personal Message (Offline)

Ignore
1714557441
Reply with quote  #2

1714557441
Report to moderator
1714557441
Hero Member
*
Offline Offline

Posts: 1714557441

View Profile Personal Message (Offline)

Ignore
1714557441
Reply with quote  #2

1714557441
Report to moderator
apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 05, 2023, 10:17:15 AM
 #22


I wanted to test it further, so I did:

Code:
sudo hdparm -tT /dev/sda

To my surprise, I got:

Code:
/dev/sda:
 Timing cached reads:   1776 MB in  2.00 seconds = 888.80 MB/sec
 Timing buffered disk reads:  62 MB in  4.67 seconds =  13.28 MB/sec

Isn't it too slow for an SSD ? Especially the second timer.

LoyceV
Legendary
*
Offline Offline

Activity: 3290
Merit: 16577


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
December 05, 2023, 10:30:22 AM
Merited by ABCbits (1)
 #23

Code:
/dev/sda:
 Timing buffered disk reads:  62 MB in  4.67 seconds =  13.28 MB/sec
Isn't it too slow for an SSD ? Especially the second timer.
Most microSD cards are faster than this nowadays. It should be 10 times faster:
Image loading...

Did you run your disk speed test during IBD? If so, that's probably why it's slow.

The type of SSD matters too: some perform just as you'd expect, and others are only fast "in short burst", and after writing the burst data, it gets much slower, up to the point that combined read and writes can make the entire system freeze for a while. That doesn't matter much for normal computer usage, but it matters a lot during heavy tasks (such as the IBD).

apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 05, 2023, 10:36:47 AM
 #24


Most microSD cards are faster than this nowadays. It should be 10 times faster:

Did you run your disk speed test during IBD? If so, that's probably why it's slow.

The type of SSD matters too: some perform just as you'd expect, and others are only fast "in short burst", and after writing the burst data, it gets much slower, up to the point that combined read and writes can make the entire system freeze for a while. That doesn't matter much for normal computer usage, but it matters a lot during heavy tasks (such as the IBD).

Hi Loyce.

No my IBD is finished and my node is stopped. So essentially my RPi is connected to an SSD which has the whole bitcoin-core structure, but bitcoind is not running.

I also ran fstrim -v on the mounted directory and it trimmed some data, but it didn't work afterwards. I mean no amelioration was seen.

LoyceV
Legendary
*
Offline Offline

Activity: 3290
Merit: 16577


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
December 05, 2023, 10:48:28 AM
Merited by ABCbits (1)
 #25

No my IBD is finished and my node is stopped. So essentially my RPi is connected to an SSD which has the whole bitcoin-core structure, but bitcoind is not running.
Which SSD do you have exactly?
I'm just guessing here: is it possible you're using a very low quality USB cable?
Have you tried Gnome Disks? It has a Benchmark feature.
Or have a look at GSmartControl, see if it can give you a reason for the low speed.

Quote
I also ran fstrim -v on the mounted directory and it trimmed some data, but it didn't work afterwards. I mean no amelioration was seen.
That shouldn't matter for "hdparm -tT", it doesn't use the file system.

apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 05, 2023, 11:09:21 AM
 #26

Which SSD do you have exactly?

This is my disk: https://www.amazon.de/-/en/Intenso-Internal-Inch-SATA-Black/dp/B0B63HPPG3

I'm just guessing here: is it possible you're using a very low quality USB cable?
Have you tried Gnome Disks? It has a Benchmark feature.
Or have a look at GSmartControl, see if it can give you a reason for the low speed.

No errors unfortunately... with GSmartControl

Could the format be an issue? My disk is exfat

EDIT: I think I will backup my drive and then format to ext4

LoyceV
Legendary
*
Offline Offline

Activity: 3290
Merit: 16577


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
December 05, 2023, 11:21:21 AM
 #27

I can't find an English review for this exact model, but my Intenso USB stick is faster than what you get.

Quote
Could the format be an issue? My disk is exfat
The filesystem matters, but not for raw speed tests.

apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 05, 2023, 11:40:38 AM
 #28


I can't find an English review for this exact model, but my Intenso USB stick is faster than what you get.


Perhaps a format will solve the issue...

LoyceV
Legendary
*
Offline Offline

Activity: 3290
Merit: 16577


Thick-Skinned Gang Leader and Golden Feather 2021


View Profile WWW
December 05, 2023, 11:49:55 AM
 #29

Perhaps a format will solve the issue...
Nope. A hdparm speed test doesn't care about the filesystem.

apogio (OP)
Sr. Member
****
Online Online

Activity: 420
Merit: 956



View Profile WWW
December 05, 2023, 12:05:18 PM
Last edit: December 05, 2023, 12:55:37 PM by apogio
 #30

Nope. A hdparm speed test doesn't care about the filesystem.

So the current speeds have gone up to:

Code:
/dev/sda:
 Timing cached reads:   1666 MB in  2.00 seconds = 834.15 MB/sec
 Timing buffered disk reads: 328 MB in  3.15 seconds = 104.15 MB/sec

I feel stupid, but here is what happened... I was using the USB 2.0 port and not the 3.0 port.

Pages: « 1 [2]  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!