Bitcoin Forum
November 21, 2017, 06:02:47 PM *
News: Latest stable version of Bitcoin Core: 0.15.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 [14] 15 16 17 18 19 20 21 22 »  All
  Print  
Author Topic: [ANN] Bitcoin blockchain data torrent  (Read 206694 times)
ddrown
Newbie
*
Offline Offline

Activity: 3


View Profile
August 19, 2014, 07:57:54 PM
 #261

Since I was curious about the new torrent, here's some info:

new bootstrap.dat contains up to block height 313000 (July 8 )


WTF are you talking about? Last torrent was from april 2014.

See post on page 12:

Beta-testing and pre-seeding a new torrent at http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent

Please only join if you already have an old bootstrap.dat file, or you built the new one yourself using linearize.py and bitcoind.

...
1511287367
Hero Member
*
Offline Offline

Posts: 1511287367

View Profile Personal Message (Offline)

Ignore
1511287367
Reply with quote  #2

1511287367
Report to moderator
1511287367
Hero Member
*
Offline Offline

Posts: 1511287367

View Profile Personal Message (Offline)

Ignore
1511287367
Reply with quote  #2

1511287367
Report to moderator
1511287367
Hero Member
*
Offline Offline

Posts: 1511287367

View Profile Personal Message (Offline)

Ignore
1511287367
Reply with quote  #2

1511287367
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
zvs
Legendary
*
Offline Offline

Activity: 1484


I have some bitcoins. Somewhere.


View Profile WWW
August 21, 2014, 08:34:15 AM
 #262

The linearize.py thing always craps out before it finishes for me.  I have the blockchain up to 316481 just as a 7z file, and it's 16,023,242,033 bytes vs this bootstrap from April (?)  that's 17,111,384,xxx...

Dacentec, best deals for US dedicated servers. They regularly restock $20-$25 Opterons with 8-16GB RAM & 2x1-2TB HDD's (ofc, usually lots of other good stuff to choose from).  I did a Serverbear benchmark of one of my $20/mo Opteron (June last year), it's here.  Have had about a half dozen different servers with Dacentec, & none have failed to sustain at least 40MB/s (burst higher). My favorite is a 12-month rent-to-own ZT Systems 2XL5520 16GB 2x2TB SATA for $40/month (got lucky with the 'off-brand', haven't seen a RTO 2xL5520 for under $50/mo since -- at least for monthly contracts).  wholesaleinternet.com has some ancient 2-core intel CPUs @ $10/mo sometimes (I got an Intel Core 2 6300 @ 1.86GHz, with a 250GB HDD with 46000 hours on it, LOL. $20 @ Dacentec is much better, if you can grab one). joesdatacenter.com (same location as Wholesale Internet) also occasionally has specials (or if you don't want to wait, it has an AMD Opteron 170 @ $16/mo).
rav3n_pl
Legendary
*
Offline Offline

Activity: 1253


Don`t panic! Organize!


View Profile WWW
August 21, 2014, 10:28:44 AM
 #263

See in linearize log, in my case it crashes on rpc timeout sometimes.
I has change timeout in code and run linearize as nice Smiley

1Rav3nkMayCijuhzcYemMiPYsvcaiwHni  Bitcoin stuff on my OneDrive
My RPC CoinControl for any coin https://bitcointalk.org/index.php?topic=929954
Some stuff on https://github.com/Rav3nPL/
jgarzik
Legendary
*
Offline Offline

Activity: 1470


View Profile
August 23, 2014, 11:49:30 PM
 #264

Torrent officially updated!  See OP.  New height:  317,000 @ 22.5 GB

Jeff Garzik, bitcoin core dev team and BitPay engineer; opinions are my own, not my employer.
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
jgarzik
Legendary
*
Offline Offline

Activity: 1470


View Profile
August 24, 2014, 02:40:06 AM
 #265

Note:  For a minority of users, the bootstrap.dat "one huge 20GB file" import method does not work beyond 4GB of data.  This is due to some limitations with large files on some 32-bit operating systems.  It is planned to move away from a single bootstrap.dat file to a directory full of blkNNNNN.dat files that may be imported directly into bitcoind via "-reindex".  The bootstrap.dat file also causes a 2x disk space increase over the "-reindex" method, which occasionally triggers complaints from users on low disk space cloud servers.

For these reasons, bootstrap.dat import method is being deprecated (at least with regards to this torrent).  Today's torrent update will be the last bootstrap.dat torrent.

Future torrents will include the block chain split into multiple files, never exceeding 1GB in size.



Jeff Garzik, bitcoin core dev team and BitPay engineer; opinions are my own, not my employer.
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
Sukrim
Legendary
*
Offline Offline

Activity: 2184


View Profile
August 24, 2014, 08:46:31 AM
 #266

As far as I understood it, bootstrap.dat gets loaded automatically while with "-reindex" people need to know how to add something to a command line. I am not sure if this is not causing more issues for more people than the ones trying to run Bitcoin-Core on some ancient hardware.

Also Bitcoin-Core could prompt the user after importing from bootstrap.dat to delete the file, to combat the "double space taken" issue. I'd at least like to see both approaches continued until Bitcoin-Core finally is capable of downloading blocks from more than one source, then this whole thing can be discontinued anyways.

https://bitfinex.com <-- leveraged trading of BTCUSD, LTCUSD and LTCBTC (long and short) - 10% discount on fees for the first 30 days with this refcode: x5K9YtL3Zb
Mail me at Bitmessage: BM-BbiHiVv5qh858ULsyRDtpRrG9WjXN3xf
Adriano
Staff
Legendary
*
Offline Offline

Activity: 1060



View Profile
August 24, 2014, 01:36:00 PM
 #267

As far as I understood it, bootstrap.dat gets loaded automatically while with "-reindex" people need to know how to add something to a command line. I am not sure if this is not causing more issues for more people than the ones trying to run Bitcoin-Core on some ancient hardware.

Also Bitcoin-Core could prompt the user after importing from bootstrap.dat to delete the file, to combat the "double space taken" issue. I'd at least like to see both approaches continued until Bitcoin-Core finally is capable of downloading blocks from more than one source, then this whole thing can be discontinued anyways.

I agree keeping the process automagically performed is better for new users.

How about include an empty file (flag file) in the torrent which only purpose is to indicate to the bitcoin daemon/wallet run the reindex process (the daemon/wallet would automatically remove this file after the reindex process is done) ?

Adriano

sd
Hero Member
*****
Offline Offline

Activity: 730



View Profile
August 25, 2014, 07:38:28 AM
 #268

I agree keeping the process automagically performed is better for new users.

Absolutely. Using a torrent at all is a hack and a (small) barrier to entry that should be removed if possible.

But if using a torrent is the current plan I can throw bandwidth at it.

There seem to be more downloaders than seeders on the new torrent right now. After changing torrents I'm downloading at 0kB/s and uploading at 1 MB/s.
Adriano
Staff
Legendary
*
Offline Offline

Activity: 1060



View Profile
August 25, 2014, 11:52:26 AM
 #269

I agree keeping the process automagically performed is better for new users.

Absolutely. Using a torrent at all is a hack and a (small) barrier to entry that should be removed if possible.

But if using a torrent is the current plan I can throw bandwidth at it.

There seem to be more downloaders than seeders on the new torrent right now. After changing torrents I'm downloading at 0kB/s and uploading at 1 MB/s.


If you already have the blockchain you should generate the file using the auxiliary script linearize.py instead of downloading it through the torrent (it is faster than downloading it and doesn't hurt the ones already seeding it, leaving bandwith for the ones who really need to download it).

Despite of that, it is good to have more seeders indeed.

Thanks,


Adriano

ddrown
Newbie
*
Offline Offline

Activity: 3


View Profile
August 27, 2014, 12:44:19 AM
 #270

Torrent officially updated!  See OP.  New height:  317,000 @ 22.5 GB

No surprises comparing this file (sha256sum d05062052be4dd6fbaeac5f17598e52f7ad545f9f938acefaf7067ecce1d7b5a) with the blockchain.  I hope posting these verifications is useful to others.

I'm doing it this way because it's faster to stream data out of bootstrap.dat rather than pulling the data out of bitcoin-cli.  So I can generate the sha256sum from the client once for a given range, and use it to verify that the data hasn't changed.  Future updates just need a checksum out of bitcoin-cli covering the new parts.  If anyone's interested in the blockheight program, I can publish it.

Blocks 0 through 295000, bootstrap matches blockchain:

Code:
$ ./blockheight -e 295000 <bootstrap-317000.dat | sha256sum
d83ea8602fb5d2ad863afc7fae1b25794bc7da37d2da642e6aca15f2ad19d9e9  -
$ for((i = 0; i < 295001; i++)); do  ./bitcoin-cli getblock `./bitcoin-cli getblockhash $i` false ; done | sha256sum
d83ea8602fb5d2ad863afc7fae1b25794bc7da37d2da642e6aca15f2ad19d9e9  -

Blocks 295001 through 313000, bootstrap matches blockchain:

Code:
$ ./blockheight -s 295001 -e 313000 < bootstrap-317000.dat | sha256sum
6cccd54b215799d91b6781b190903fb5673cf6413d2a93c5ebe26223e3b2de21  -
$ for((i = 295001; i < 313001; i++)); do  ./bitcoin-cli getblock `./bitcoin-cli getblockhash $i` false ; done | sha256sum
6cccd54b215799d91b6781b190903fb5673cf6413d2a93c5ebe26223e3b2de21  -

Blocks 313001 through 317000, bootstrap matches blockchain:

Code:
$ ./blockheight -s 313001 < bootstrap-317000.dat | sha256sum
a4ab78b82bb7b75b640a6f128fd66cb911362aa8058ebf574b4e02c111f63ba5  -
$ for((i = 313001; i < 317001; i++)); do  ./bitcoin-cli getblock `./bitcoin-cli getblockhash $i` false ; done | sha256sum
a4ab78b82bb7b75b640a6f128fd66cb911362aa8058ebf574b4e02c111f63ba5  -
jgarzik
Legendary
*
Offline Offline

Activity: 1470


View Profile
August 27, 2014, 03:26:18 PM
 #271

Thanks for double-checking my work!

Jeff Garzik, bitcoin core dev team and BitPay engineer; opinions are my own, not my employer.
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
VEscudero
Donator
Sr. Member
*
Offline Offline

Activity: 336


Bitcoin, Ripple & Blockchain pioneer


View Profile WWW
August 29, 2014, 02:13:56 PM
 #272

Future torrents will include the block chain split into multiple files, never exceeding 1GB in size.

I agree 100% with this choice, it does not make any sense to have a large file when smaller ones are easier to manage.

This way, people that already has the first blocks can skip those ones and let their bittorrent client only download the last ones.

Armory already downloads the blockchain through bittorrent by default, I wish the bitcore core client start doing it as well, until that moment you can count on me seeding this torrent manually for everyone at any time.

https://www.VEscudero.net   ★ VEscudero's Personal Blog about cybersecurity, blockchain, bitcoin and open source ★
Bitcoins: 1VESCU4YLvNYhmTsJRgFKKn3bLFeeWtJm
hops
Newbie
*
Offline Offline

Activity: 2


View Profile
August 30, 2014, 12:57:30 PM
 #273

I'm having some trouble getting the 22.5 GB file. I have the 21GB which appears to be from last April. I tried using the torrent link from the OP as well as manually adding the infohash. They both lead me to the 21 GB file. Any thought as to what I'm doing wrong?
Wealthy
Member
**
Offline Offline

Activity: 92


View Profile
August 30, 2014, 01:46:32 PM
 #274

I am confused, what is this data used for? Is this even useful? How can we benefit from it?
dserrano5
Legendary
*
Offline Offline

Activity: 1848



View Profile
August 30, 2014, 02:24:46 PM
 #275

I am confused, what is this data used for? Is this even useful? How can we benefit from it?

If you're setting up a new full node, it's faster to get the blockchain via torrent (and then let bitcoin core import and validate it) than to let bitcoin core download it by itself. This is because bitcoin core currently downloads from one peer at once, which isn't optimal.

hops
Newbie
*
Offline Offline

Activity: 2


View Profile
August 30, 2014, 07:47:18 PM
 #276

i still think the new torrent link is incorrect.
btcformat
Newbie
*
Offline Offline

Activity: 28


View Profile
August 30, 2014, 08:04:43 PM
 #277

How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent?
I have a 7mb adsl.

LetsTalkBitcoin.com/?ref=5c1fbfe4 --->0,05btc/week
jgarzik
Legendary
*
Offline Offline

Activity: 1470


View Profile
August 30, 2014, 08:54:19 PM
 #278

i still think the new torrent link is incorrect.

Can you be more specific?  Which link is incorrect?


Jeff Garzik, bitcoin core dev team and BitPay engineer; opinions are my own, not my employer.
Donations / tip jar: 1BrufViLKnSWtuWGkryPsKsxonV2NQ7Tcj
Muhammed Zakir
Hero Member
*****
Offline Offline

Activity: 560


I prefer Zakir over Muhammed when mentioning me!


View Profile WWW
August 31, 2014, 09:52:58 AM
 #279

How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent?
I have a 7mb adsl.

Downloading bootstrap.dat will take some hours and syncing will take a few hours more. Smiley It might go upto 1-2 days.

~~MZ~~

future_quark369
Newbie
*
Offline Offline

Activity: 28


View Profile
August 31, 2014, 04:32:35 PM
 #280

I'm downloading. Thank you all. It looks like a lot of time saved using them for more than a pc.
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 13 [14] 15 16 17 18 19 20 21 22 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!