Bitcoin Forum
March 29, 2024, 05:24:54 AM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 [12] 13 14 15 16 17 18 19 20 21 22 23 »  All
  Print  
Author Topic: [ANN] Bitcoin blockchain data torrent  (Read 211075 times)
Sukrim
Legendary
*
Offline Offline

Activity: 2618
Merit: 1006


View Profile
July 04, 2014, 07:02:53 PM
 #221

No change to https://github.com/bitcoin/bitcoin/blob/master/src/checkpoints.cpp, no change to this file.
I'm not going to seed some random stranger's torrent, sorry.

That being said, yes, it really could use an update + new checkpoint...

https://www.coinlend.org <-- automated lending at various exchanges.
https://www.bitfinex.com <-- Trade BTC for other currencies and vice versa.
1711689894
Hero Member
*
Offline Offline

Posts: 1711689894

View Profile Personal Message (Offline)

Ignore
1711689894
Reply with quote  #2

1711689894
Report to moderator
1711689894
Hero Member
*
Offline Offline

Posts: 1711689894

View Profile Personal Message (Offline)

Ignore
1711689894
Reply with quote  #2

1711689894
Report to moderator
"Your bitcoin is secured in a way that is physically impossible for others to access, no matter for what reason, no matter how good the excuse, no matter a majority of miners, no matter what." -- Greg Maxwell
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
rav3n_pl
Legendary
*
Offline Offline

Activity: 1361
Merit: 1003


Don`t panic! Organize!


View Profile WWW
July 04, 2014, 07:11:16 PM
 #222

Good point!
It is my torrent. I just made it and seed it on my machine.
If your torrent is showing up IPs you can see it is rav3n.dtdns.net Smiley
But if you not need/want it - do not download!

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
Some stuff on https://github.com/Rav3nPL/
sd
Hero Member
*****
Offline Offline

Activity: 730
Merit: 500



View Profile
July 06, 2014, 05:12:25 PM
 #223

I'm not going to seed some random stranger's torrent, sorry.

If you connect a full node to the bitcoin network you also download data from random strangers. As I understand it the data in this file is subjected to exactly the same checks as data downloaded by the bitcoin client itself. Should the data be misformatted it will be rejected. If some of the end blocks got reorganized the client will sort it out once it connects to the network proper.

Of course you are right to be paranoid but I don't see the need for this torrent to align with checkpoints in the code itself.
Sukrim
Legendary
*
Offline Offline

Activity: 2618
Merit: 1006


View Profile
July 06, 2014, 05:41:02 PM
 #224

After checkpoints there is little need to get data from a torrent file instead of the network itself, since it is likely a CPU or disk IO bound operation, not network speed.

Also with this other torrent file, there is no way for me (other than downloading the whole file and decompressing it) to recreate + verify it locally.

https://www.coinlend.org <-- automated lending at various exchanges.
https://www.bitfinex.com <-- Trade BTC for other currencies and vice versa.
EpptEinK
Newbie
*
Offline Offline

Activity: 8
Merit: 0


View Profile
July 07, 2014, 11:40:22 AM
Last edit: July 07, 2014, 01:02:28 PM by EpptEinK
 #225

Hey, thanks for the torrent. I downloaded the file and placed it in my btc folder. I open the client and it says its importing the block from the disk, but nothing hapens, it still says 0 out of 309616 blocks processed. It´s been like that for 1 hour. Is this normal? Thank you Smiley

EDIT: OK, its now syncronizing and the bootstrap.dat changed the name to bootstrap.dat.old, still at 0 blocks...

NEW EDIT: It doesnt sync, what should I do? Thanks.
sd
Hero Member
*****
Offline Offline

Activity: 730
Merit: 500



View Profile
July 07, 2014, 12:31:12 PM
 #226

After checkpoints there is little need to get data from a torrent file instead of the network itself, since it is likely a CPU or disk IO bound operation, not network speed.

Also with this other torrent file, there is no way for me (other than downloading the whole file and decompressing it) to recreate + verify it locally.

Network speed is an issue, that's why we are using a torrent. There are currently 14620 blocks between the end of this torrent and the end of the blockchain. Bitcoind should download about as fast as torrent does, but sadly it doesn't.

Bitcoind verifies this data when it imports it, just like when it verifies data it pulls off random network nodes. The only possible attack is a 50%+1, and if an attacker could pull that off they would do it on the main network, or more likely they would just mine half the coins instead.

EDIT: For clarity
Sukrim
Legendary
*
Offline Offline

Activity: 2618
Merit: 1006


View Profile
July 07, 2014, 01:23:02 PM
 #227

The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually.

https://www.coinlend.org <-- automated lending at various exchanges.
https://www.bitfinex.com <-- Trade BTC for other currencies and vice versa.
sd
Hero Member
*****
Offline Offline

Activity: 730
Merit: 500



View Profile
July 09, 2014, 08:36:04 AM
 #228

The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually.

Experimentation being the basis of science I tested your theory. I used a AWS m3.xlarge with a 60GB SSD block device for the bitcoin client. I created a bootstrap.dat for block 305000 and compared the time it takes to update from block 295000 to 305000 via my bootstrap.dat and by pulling blocks from the live network. It turns out you are right.

Time to update from 295000 to 305000 with a custom bootstrap.dat: 3845 seconds
Time to update from 295000 to 305000 by connecting to the live network: 3848 seconds

As a 3 second difference on a 1 hour load is meaningless I can only conclude there is no reason to update this torrent. I'll keep throwing bandwidth at it.
DeeBo
Newbie
*
Offline Offline

Activity: 52
Merit: 0


View Profile
July 10, 2014, 09:18:50 AM
 #229

The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually.

Experimentation being the basis of science I tested your theory. I used a AWS m3.xlarge with a 60GB SSD block device for the bitcoin client. I created a bootstrap.dat for block 305000 and compared the time it takes to update from block 295000 to 305000 via my bootstrap.dat and by pulling blocks from the live network. It turns out you are right.

Time to update from 295000 to 305000 with a custom bootstrap.dat: 3845 seconds
Time to update from 295000 to 305000 by connecting to the live network: 3848 seconds

As a 3 second difference on a 1 hour load is meaningless I can only conclude there is no reason to update this torrent. I'll keep throwing bandwidth at it.


One flaw in your test:  I'm pretty sure when you give the Bitcoin client a bootstrap.dat file it doesn't just "update" but instead rescans the entire blockchain database on your hard drive.  That's why the bootstrap.dat is meant to be used on a fresh install because if you already have a good chunk of the blockchain downloaded you're usually better off just letting the client update from the network.

Also not everyone has the bandwidth of an extra large AWS instance.  With my slow 3mbps/384kbps DSL line, I may be the exception in that I could possibly rebuild my local database faster than I could download the latest blocks.
sd
Hero Member
*****
Offline Offline

Activity: 730
Merit: 500



View Profile
July 15, 2014, 01:40:00 PM
 #230

One flaw in your test...

I didn't go into exact details about how I tested because discussions like this tend to never end. If there was a significant advantage or disadvantage to using the torrent I think I would have seen it.

Please do treat my results with scepticism and test yourself.
giveBTCpls
Sr. Member
****
Offline Offline

Activity: 322
Merit: 250


View Profile
July 15, 2014, 02:17:01 PM
 #231

Would be too much to ask if they added like, not daily but maybe weekly updated blockchain file? Everytime someone new comes to Bitcoin, the first thing they say is how much of a pain in the ass it is to sync, unless they are using 3rd party wallets that is, but im too used to the simple niceness of the classic wallet to change  Smiley

rav3n_pl
Legendary
*
Offline Offline

Activity: 1361
Merit: 1003


Don`t panic! Organize!


View Profile WWW
July 15, 2014, 06:20:27 PM
 #232

Looks like update needed Smiley
I made a linear block chain up to 309000, 7zip it and put into torrent.
It is like 12,3GB.
My home upload is ~500kb/s so it will take some time to move it to better seeds... hopefully one day tops Smiley
magnet link:
Code:
magnet:?xt=urn:btih:8347fcc3df300e5a31e2304442c128e308256dfc&dn=bitcoin309000&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80&tr=udp%3a%2f%2ftracker.publicbt.com%3a80&tr=udp%3a%2f%2ftracker.istole.it%3a80%2fannounce&tr=udp%3a%2f%2fopen.demonii.com%3a1337
Have fun Smiley

Looks like at least 10 ppl downloaded it but noone seed? :/

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
Some stuff on https://github.com/Rav3nPL/
sd
Hero Member
*****
Offline Offline

Activity: 730
Merit: 500



View Profile
July 15, 2014, 09:53:54 PM
 #233

Would be too much to ask if they added like, not daily but maybe weekly updated blockchain file? Everytime someone new comes to Bitcoin, the first thing they say is how much of a pain in the ass it is to sync, unless they are using 3rd party wallets that is, but im too used to the simple niceness of the classic wallet to change  Smiley

There isn't a 'they', there is only an 'us'. If you think it should be done then do it. I was going to but my tests showed that using a bootstrap file doesn't load data into bitcoind any faster than pulling the data from the live network for blocks beyond 295000. The recent blocks seem more complicated than earlier ones. Maybe a bigger bootstrap file would still be useful to some people.

I really think that most users should be using a light client like electrum anyway. Interested companies, organizations, and technical users should be running the full nodes, not every guy who wants to make small purchases.
georgem
Legendary
*
Offline Offline

Activity: 1484
Merit: 1007


spreadcoin.info


View Profile WWW
July 15, 2014, 11:15:28 PM
Last edit: July 16, 2014, 06:27:58 AM by georgem
 #234

I am checking this out now.

A month ago it took me about a day to download the whole blockchain with the wallet.
I will see how fast the torrent and validating is.

At the moment it's very promising, like 25 MB/s download speed.

georgem
Legendary
*
Offline Offline

Activity: 1484
Merit: 1007


spreadcoin.info


View Profile WWW
July 15, 2014, 11:26:43 PM
Last edit: July 16, 2014, 02:42:13 AM by georgem
 #235

Alright. It took 26 minutes to download.
Now starting the wallet..

It says it's importing data.... fine...

10 minutes in... it has imported about 170'000 blocks....

1 hour later ... 230k blocks.

1.5 hours later .... importing block 250k.... importing sure takes a lot of time...  Sad but we are getting there...

2 hours, 270k (that's end of november 2013)... at this rate it should take another hour to finish...

I was wrong... 3 hours, it's at 283k... I give up... I have to get some sleep... lol...

PS progress bar is at about 40%... but don't think its an accurate estimation of time needed.

But if it is, then it might take another 3-4 hours to stop.... will see tomorrow...

georgem
Legendary
*
Offline Offline

Activity: 1484
Merit: 1007


spreadcoin.info


View Profile WWW
July 16, 2014, 06:21:26 AM
 #236

7 weeks to go.
it took 7 hours to get here.
It'll probably finish now in a 1 hour or so...

Now it switched to synchronizing with network for the remaining blocks that weren't in the torrent.

Muhammed Zakir
Hero Member
*****
Offline Offline

Activity: 560
Merit: 506


I prefer Zakir over Muhammed when mentioning me!


View Profile WWW
July 16, 2014, 10:46:46 AM
 #237

Alright. It took 26 minutes to download.
Now starting the wallet..

It says it's importing data.... fine...

10 minutes in... it has imported about 170'000 blocks....

1 hour later ... 230k blocks.

1.5 hours later .... importing block 250k.... importing sure takes a lot of time...  Sad but we are getting there...

2 hours, 270k (that's end of november 2013)... at this rate it should take another hour to finish...

I was wrong... 3 hours, it's at 283k... I give up... I have to get some sleep... lol...

PS progress bar is at about 40%... but don't think its an accurate estimation of time needed.

But if it is, then it might take another 3-4 hours to stop.... will see tomorrow...

You can use this command for increasing syncing speed from your computer not from internet. Smiley
Code:
-dbcache=<n>           Set database cache size in megabytes (4 to 4096, default: 100)

You can use this command to decrease the connection to number of peers, if it is affecting your internet browsing.
Code:
-maxconnections=<n>    Maintain at most <n> connections to peers (default: 125)
IMO it won't affect in a great way but might affect in a very low speed networks.

Kindly,
        MZ

jgarzik (OP)
Legendary
*
Offline Offline

Activity: 1596
Merit: 1091


View Profile
July 31, 2014, 02:39:36 PM
Last edit: July 31, 2014, 02:59:52 PM by jgarzik
 #238

Beta-testing and pre-seeding a new torrent at http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent

Please only join if you already have an old bootstrap.dat file, or you built the new one yourself using linearize.py and bitcoind.

Code:
magnet link:
magnet:?xt=urn:btih:682759b001fac5d3b0d8517d2a179af2e65ebed6&dn=bootstrap.dat&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Ftracker.publicbt.com%3A80&tr=udp%3A%2F%2Ftracker.ccc.de%3A80&tr=udp%3A%2F%2Ftracker.istole.it%3A80

Jeff Garzik, Bloq CEO, former bitcoin core dev team; opinions are my own.
Visit bloq.com / metronome.io
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
2112
Legendary
*
Offline Offline

Activity: 2128
Merit: 1060



View Profile
July 31, 2014, 05:30:08 PM
Last edit: August 05, 2014, 02:31:18 AM by 2112
 #239

Does tracker.ccc.de work for anyone anywhere in the world besides .at, .ch & .de?

Maybe it should be changed to "udp://open.demonii.com:1337" like all the newer torrents? This new tracker is accessible worldwide.

Edit: After reviewing the recent statistics of reach-ability of demonii.com I no longer recommend it.

What about other trackers? Open, less politicized,  trackers, that aren't associated with thepiratebay.se? Or maybe differently politicized trackers associated with other organizations? While those 4 trackers are reliable and well defended against DDoS, they are also the ones that are most commonly blocked/censored/filtered by various software nannies.

Please comment, critique, criticize or ridicule BIP 2112: https://bitcointalk.org/index.php?topic=54382.0
Long-term mining prognosis: https://bitcointalk.org/index.php?topic=91101.0
jgarzik (OP)
Legendary
*
Offline Offline

Activity: 1596
Merit: 1091


View Profile
July 31, 2014, 07:53:49 PM
Last edit: July 31, 2014, 09:46:17 PM by jgarzik
 #240

What about other trackers? Open, less politicized,  trackers, that aren't associated with thepiratebay.se? Or maybe differently politicized trackers associated with other organizations? While those 4 trackers are reliable and well defended against DDoS, they are also the ones that are most commonly blocked/censored/filtered by various software nannies.

I don't pretend to be a tracker expert, and actively solicit suggestions.

I would certainly bias towards less politicized + more reliable trackers.

Please post your tracker suggestions.


Jeff Garzik, Bloq CEO, former bitcoin core dev team; opinions are my own.
Visit bloq.com / metronome.io
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
Pages: « 1 2 3 4 5 6 7 8 9 10 11 [12] 13 14 15 16 17 18 19 20 21 22 23 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!