Bitcoin Forum

Bitcoin => Bitcoin Technical Support => Topic started by: theboarderdude on December 24, 2014, 01:08:46 AM



Title: Ridiculously slow bitcoin core wallet sync
Post by: theboarderdude on December 24, 2014, 01:08:46 AM
I downloaded bitcoin core 0.9.3 yesterday morning(the 22nd) and I've had it syncing since. I'm still 1 year and 29 weeks behind, currently on block 239343. Last time I downloaded a wallet a couple months ago, it took less than 12 hours to download. I have charter for internet, to fairly fast there. Am I doing something wrong?? Trouble shooting tips? Thanks in advance!


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: Newar on December 24, 2014, 11:47:46 AM

A quick search will find the torrent for bootstrap.dat .

Also look for the connect= command.

But yeah, it takes time.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: Meuh6879 on December 24, 2014, 12:49:43 PM
and majority of time is not the internet connexion ... but the CPU and hard drive speed.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: shorena on December 24, 2014, 01:16:18 PM
and majority of time is not the internet connexion ... but the CPU and hard drive speed.

Cant confirm, 8 year old laptop = bottleneck is the internet connection.

@OP use the connect=IP command with a server that has a fast internet connection. See below for IPs to use.

Code:
 last updated 2014.12.21
-------------------------------------------------------------------------------------------------
IP                  - location             - owner[1]  -  speed      - info/stats page[2] - testnet
-------------------------------------------------------------------------------------------------
84.200.34.113       - Freinsheim, DE, EU   - Newar     - 1000 mbit/s - yes                - no
185.45.192.129      - Amsterdam, NL, EU    - anon      - 1000 mbit/s - /node.php[3]       - yes
213.165.91.169      - Germany, EU          - shorena   -  100 mbit/s - yes                - no
104.45.145.179      - unknown              - grue      -  100 mbit/s - no                 - no
-------------------------------------------------------------------------------------------------
!! The following nodes have been unreachable at the time of the last update and might be down  !!
-------------------------------------------------------------------------------------------------
eldinhadzic.org[4]  - LA, USA              - eldinhadz - 1000 mbit/s - no                 - no
50.7.68.180         - New York, USA        - Newar     -  100 mbit/s - yes                - no
5.9.24.81           - Germany, EU          - zvs       -  unknown    - no                 - no
178.79.173.71       - United Kingdom, EU   - zvs       -  unknown    - no                 - no
107.155.104.194     - Dalls, USA           - zvs       -  unknown    - no                 - no
106.185.32.195      - Japan, Asia          - zvs       -  unknown    - no                 - no
94.242.57.173       - Russia, Asia         - zvs       -  unknown    - no                 - no
-------------------------------------------------------------------------------------------------
[1] refers to a bitcointalk.org username or anon if requested
[2] same IP, port 80 or path/port given
[3] work in progress
[4] IP is 173.236.158.177


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: gab0miner on December 24, 2014, 01:39:26 PM
there are a post in General Discussion about this. The solution is download a big part of blockchain with bittorrent

Posted From bitcointalk.org Android App


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: theboarderdude on December 24, 2014, 06:14:18 PM
@shorena I used the Amsterdam address and I was able to download the remaining ~100,000 blocks in about 7 hours. Thanks!


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: rsvoter on December 24, 2014, 06:56:31 PM
there are a post in General Discussion about this. The solution is download a big part of blockchain with bittorrent

Posted From bitcointalk.org Android App

Yeah that post helped cheers


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BitcoinChick86 on December 24, 2014, 07:40:22 PM
Thanks for the post Shorena, Mine has been syncing for and got to 138000 in 3 days, now its done 15000 blocks in about 5 minutes :D


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: carlosiness on December 24, 2014, 07:45:31 PM
that's why i stopped using this wallet, use MultiBit which doesn't download whole blockchain, unless you are security guy :)
my laptop has 4 cores and 8gb of ram, it took me 2 days to get blockcain and cpu was so hot that seemed it will burn..


Title: Re:
Post by: Triffin on December 24, 2014, 07:49:53 PM
Ridiculously slow bitcoin core wallet sync ..

And yet another reason why BTC or ( insert favorite alt ) won't be going mainstream any time soon ..

Triff ..


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BitHarry on December 24, 2014, 08:11:55 PM
I disagree, Just because its a large does not me its inaccessable, Internet connections are getting better and im sure they will find a way to cut the blockchain down. Bitcoin-QT is by far the most stable wallet IMO and I have used them all, I have had problems with them all apart from Bitcoin-QT


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: shorena on December 24, 2014, 09:21:56 PM
Thanks for the post Shorena, Mine has been syncing for and got to 138000 in 3 days, now its done 15000 blocks in about 5 minutes :D

@shorena I used the Amsterdam address and I was able to download the remaining ~100,000 blocks in about 7 hours. Thanks!

glad I could help.


I disagree, Just because its a large does not me its inaccessable, Internet connections are getting better and im sure they will find a way to cut the blockchain down. Bitcoin-QT is by far the most stable wallet IMO and I have used them all, I have had problems with them all apart from Bitcoin-QT

Satoshi predicted this. There are several posts hinting towards the majority of users using slim clients. IIRC Satoshis upper bound was <100,000 full nodes ever and slim clients for the rest.
On the other hand we have the bitcoin core devs [1] working on a way to make a it semi slim clients where you can configure an upper bound of diskspace the node can use.
I think any reasonable [2] wallet is fine and there is (or at least will be) a wallet for every kind of user.


[1] here is a recent post where this came up https://bitcointalk.org/index.php?topic=904383.0
[2] proper encryption, you control the keys, capable of backups etc.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BitcoinChick86 on December 24, 2014, 10:14:00 PM
I always plan to run a full node no matter how big it gets, unless it gets over 2 TB then I may need to pay for a new server ;)


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BookLover on December 24, 2014, 11:25:23 PM
If it ever reaches 2TB, I'll have an excuse to build myself a larger RAID array (and maybe the funds too ;)).


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BitcoinChick86 on December 24, 2014, 11:56:07 PM
If it ever reaches 2TB, I'll have an excuse to build myself a larger RAID array (and maybe the funds too ;)).

I love the way techies always find "excuses" to upgrade their hardware. My motherboard was recently playing up... maybe? I dunno, I just wanted an X99 Chipset and DDR4 RAM :(


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: crazyearner on January 02, 2015, 12:53:03 PM
If it ever reaches 2TB, I'll have an excuse to build myself a larger RAID array (and maybe the funds too ;)).

I love the way techies always find "excuses" to upgrade their hardware. My motherboard was recently playing up... maybe? I dunno, I just wanted an X99 Chipset and DDR4 RAM :(

Yup its the perfect excuse to upgraded. Even tho I have about 16TB of space but used for Burstcoin mining ill still find some way of needing an upgrade and soon be buying some 6TB hard drives or maybe the new 10TB hard drives when out this year depending on prices. Is good to upgrade every few years or just upgrade to high end equipment and not have to be worried about upgrading for a long time.

 Have a nice system with a AMD (Piledriver) FX-8350 4.00GHz  Black edition over clocked to 5GH water cooled and never get any problems with it and right now the newest chip out since buying is AMD (Piledriver) FX-9590. So theirs only been 3 releases of new cpus since I got my 8350 Only time when I will be upgrading again possibly is when they introduce the 12 core this year or maybe when theirs 16 core and can max that with all the video editing and music production I do.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RD965 on January 02, 2015, 01:50:20 PM
If it ever reaches 2TB, I'll have an excuse to build myself a larger RAID array (and maybe the funds too ;)).

lol its very far from 2tb. Raid setups are always less safe!


Title: Re:
Post by: altcoinex on January 03, 2015, 03:52:19 PM
Ridiculously slow bitcoin core wallet sync ..

And yet another reason why BTC or ( insert favorite alt ) won't be going mainstream any time soon ..

Triff ..

SPV Mode, Pruning, and Lightweight Wallet clients have a different opinion for the future.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BookLover on January 06, 2015, 03:59:19 PM
Raid setups are always less safe!
I'm not sure where you heard this, but it is not true.  Depending on the RAID level used a RAID array can be dramatically safer than independent disks.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RD965 on January 07, 2015, 11:20:22 AM
Raid setups are always less safe!
I'm not sure where you heard this, but it is not true.  Depending on the RAID level used a RAID array can be dramatically safer than independant disks.

Nope

Its a well known thing, because for speed youll normally use RAID0, and if for every reason one of the hdds crashes the whole set would be unusable


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BookLover on January 07, 2015, 08:39:19 PM
You're correct in saying that RAID 0 is less safe than independent disks as you will lose the data on all disks rather than just one if one fails.  However, my previous statement is still true:
Depending on the RAID level used, a RAID array can be dramatically safer than independent disks.
For example RAID 1, which mirrors the data on the disks, is much safer than simply using independent disks.  RAID 5, 6, and 1+0 also incorporate various levels of redundancy, while independent disks do not.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RD965 on January 08, 2015, 08:26:43 AM
You're correct in saying that RAID 0 is less safe than independant disks as you will lose the data on all disks rather than just one if one fails.  However, my previous statement is still true:
Depending on the RAID level used, a RAID array can be dramatically safer than independant disks.
For example RAID 1, which mirrors the data on the disks, is much safer than simply using independant disks.  RAID 5, 6, and 1+0 also incorporate various levels of redundancy, while independant disks do not.

I dont see the point on using any other than RAID0, because what you want is speed, otherwise what do you mean?


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BookLover on January 08, 2015, 03:22:23 PM
RAID arrays are not always used for speed.  They can be used for:
Quote from: Wikipedia
   To make the loss of data happen less often. This is done by having several copies of the data.
    To get more storage space by having many smaller disks.
    To get more flexibility (Disks can be changed or added while the system keeps running)
    To get the data more quickly.
So again, in response to:
Raid setups are always less safe!
I say:
Depending on the RAID level used a RAID array can be dramatically safer than independent disks.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RD965 on January 08, 2015, 05:17:22 PM
RAID arrays are not always used for speed.  They can be used for:
Quote from: Wikipedia
   To make the loss of data happen less often. This is done by having several copies of the data.
    To get more storage space by having many smaller disks.
    To get more flexibility (Disks can be changed or added while the system keeps running)
    To get the data more quickly.
So again, in response to:
Raid setups are always less safe!
I say:
Depending on the RAID level used a RAID array can be dramatically safer than independent disks.

Agree

Then you have the choice of speed vs reliability

In the "mirroring" mode, dont you lose space and speed? Whats the difference between having that and a backup hdd?


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RoadStress on January 09, 2015, 01:06:58 AM
Maybe a bit offtopic, but I don't know where to address this. What type of hard drive would be the best for storing the blockchain running as a full node? Will a SSD drive die sooner than a regular drive?


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: BookLover on January 09, 2015, 02:56:07 AM
In the "mirroring" mode, dont you lose space and speed? Whats the difference between having that and a backup hdd?
Yes you lose space, but not speed.  I've read you may actually have a slight gain in reed speed, but that's irrelevant.  The difference is it's a mirror, not a backup, so if you delete something it is deleted from both hdd's.  However, you have the benifit of being able to replace a drive if it dies while still using the computer.  It will be slower while the RAID arrays rebuilds, but in a business the lack of downtime is important.

@RoadStress: I don't mean to ignore you, I just don't know the answer to your question.  I would love to see a seperate topic started on this.  So if you start one, please link to it in this thread or send me a pm.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: shorena on January 09, 2015, 08:51:56 AM
Ill stop following this thread, if anyone has any more questions regarding the threads topic, feel free to open a new thread.

Your "what is a raid level" discussion should have been removed, but apparently mods disagree about it beeing off topic.


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RD965 on January 09, 2015, 08:56:07 AM
Maybe a bit offtopic, but I don't know where to address this. What type of hard drive would be the best for storing the blockchain running as a full node? Will a SSD drive die sooner than a regular drive?

SSD drives are meant to be more durable than mechanical HDD's, the only disadvantage is obviously the $/GB, and since there is a faster access to the files (because SSD's use flash drive technology) It would be more suitable for any task


p.s. Cheers BookLover  :)


Title: Re: Ridiculously slow bitcoin core wallet sync
Post by: RoadStress on January 09, 2015, 12:29:48 PM
In the "mirroring" mode, dont you lose space and speed? Whats the difference between having that and a backup hdd?
Yes you lose space, but not speed.  I've read you may actually have a slight gain in reed speed, but that's irrelevant.  The difference is it's a mirror, not a backup, so if you delete something it is deleted from both hdd's.  However, you have the benifit of being able to replace a drive if it dies while still using the computer.  It will be slower while the RAID arrays rebuilds, but in a business the lack of downtime is important.

@RoadStress: I don't mean to ignore you, I just don't know the answer to your question.  I would love to see a seperate topic started on this.  So if you start one, please link to it in this thread or send me a pm.

Sure. Just name the appropriate sub-forum and I'll do it. Here on Technical Support?

Discuss the topic here: https://bitcointalk.org/index.php?topic=918890.new#new

Thank you.