|
Title: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on February 20, 2013, 03:55:14 PM This is a torrent of the publicly available bitcoin blockchain data.
IMPORTANT NOTE: As of Bitcoin Core version 0.10.0 or later, this torrent is slower than a direct download using the bitcoin P2P protocol & client. This torrent is now only maintained for research and development purposes as a secondary option. Please use Bitcoin Core directly to download the blockchain. Bitcoin-Qt/bitcoind version 0.7.1 and later supports a special import feature: If the file "bootstrap.dat" is found in the bitcoin data directory, it will validate and import all blockchain data found in that file. The following torrent presents a bootstrap.dat file for that feature. Here is the PGP-signed torrent information. The public key for jgarzik@bitpay.com may be found at public keyservers or http://bitcoin.org/jgarzik-bitpay.asc Details follow below the signature. Updated: August 23, 2014 http://gtf.org/garzik/bitcoin/bootstrap.txt Code: -----BEGIN PGP SIGNED MESSAGE----- What is bootstrap.dat? It is a flat, binary file containing bitcoin blockchain data, from the genesis block through height 317,000. Versions 0.7.1+ automatically validates and imports a file in the data directory named "bootstrap.dat". Special note: Version prior to 0.8.0 have a bug which will only import 2G of data from a file. This is fixed in 0.8.0. Who wants bootstrap.dat? Anyone bringing up a new node using the reference client. This is one method of accelerating the initial blockchain download process, while helping the bitcoin P2P network by offloading data download traffic from public P2P nodes. This download is not for those who are already running the bitcoin client. How often will this torrent be updated? Assuming this project is deemed useful and worth continuing... the torrent will be updated once every few months, when the checkpoints are updated in the reference client source code (https://github.com/bitcoin/bitcoin/). Why not update the torrent more often? A torrent works best when it is a large, static dataset that changes infrequently. That maximizes the ability to seed the data, enabling even part-timer seeders to contribute meaningfully. Less frequent changes also minimizes the risk that a malicious torrent will appear, with a long, malicious side chain. The current policy only updates the torrent after blocks are buried many thousands deep in the chain. Why should I trust you? You don't have to: This data is raw block chain data. The client will verify this data during import. Independent third parties may generate their own bootstrap.dat, up to height 317,000, and verify that the sha256sum matches that posted above. The file format is simple and publicly known: <4-byte pchMessageStart><32-bit length><CBlock, serialized in network wire format> Torrent file download? If the magnet link does not work, download the torrent file from How can I help? Do you need more seeds? Yes, we need as many long term seeds as possible. This ensures we can meet torrent download demand immediately at high speeds, and remain idle the remainder of the time. Generate the file myself? You may generate the file yourself, rather than downloading it, if you have Bitcore Core and python. The tool used to generate bootstrap.dat is https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize Comments welcome Post any comments or experiences in this thread. I'll update the OP as needed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Scrat Acorns on February 20, 2013, 04:00:17 PM Direct download mirror: https://bitfetch.com/static/bootstrap.7z (https://bitfetch.com/static/bootstrap.7z)
(compressed using 7z/LZMA2 - 2.7 vs. 4.7 GiB) If you can seed, use the torrent instead. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: coblee on February 20, 2013, 05:57:56 PM If I already have some block data and want to replace them with this, do I need to delete my blk*.dat files? How about the blocks or chainstate directory?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BitcoinBug on February 20, 2013, 06:23:18 PM I was seeding the previous version (2.3 GB, share ratio 15) and when I added this one, it picked up and verified the existing version and continued downloading from 51%. Very cool!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: mc_lovin on February 20, 2013, 06:36:24 PM This is a great idea, although I am a bit confused as to the future as we won't all need to keep a full node anymore, but I'm sure that will come into understanding in the coming weeks.
Seeding this as much as possible! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on February 20, 2013, 07:37:08 PM How to find the data directory (where this file belongs to):
https://en.bitcoin.it/wiki/Data_directory (<-- this also needs a bit of updating for the different files/folders with 0.8) Some more hash values of this bootstrap.dat file (up to 216116): Adler32: FA0EEF4C CRC32: DDF59E6B MD5: 1B437D44213B7D98C974546B55834D10 SHA-1: 985380032B618281EC5B9B49AFDCC99A4BCD69EB SHA-256: BF658C7055B733BFC15EA167F298C5599B89D220B14DBE7C8EF20B18E468C451 Unfortunately it's not possible (yet?) in Bittorrent to share HTTP seeds in a swarm (DDoS potential!), but still - if you have a web server to seed this file but cannot run Bittorrent, you might still post a link here, so you can be added to the Magnet URI/torrent file. HTTP seeds are in most clients actually quite rarely used, so unless people start to direct download from these you might not even have heavy traffic going on. Also if you cannot use Bittorrent, there are services around that download torrents for BTC for you and offer a HTTPS download link. I won't link these here as I don't want to make it look like I endorse any of these. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on February 20, 2013, 07:53:52 PM If I already have some block data and want to replace them with this, do I need to delete my blk*.dat files? How about the blocks or chainstate directory? This is not a replacement for block data you already have. This is a separate file, that is only used once, during data import. After data import, the file is renamed to bootstrap.dat.old, and never touched again. Most will want to manually delete it, after use. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on February 20, 2013, 10:09:02 PM If I already have some block data and want to replace them with this, do I need to delete my blk*.dat files? How about the blocks or chainstate directory? This is not a replacement for block data you already have. This is a separate file, that is only used once, during data import. After data import, the file is renamed to bootstrap.dat.old, and never touched again. Most will want to manually delete it, after use. You can use the bootstrap.dat torrent with no ill effects regardless of your current block. When you restart and Bitcoin sees the bootstrap.dat that you have dropped in it's data directory, any block hashes you already have will be skipped quickly, and the import will pick up at the blocks you don't have. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dooglus on February 21, 2013, 05:03:36 AM I have an up-to-date copy of the blockchain. Is there an easy way to generate bootstrap.dat from it so I can seed it without having to download the whole thing again?
I'm thinking it might be relatively easy to modify the armory source code to dump out a bootstrap.dat file, but won't bother if something already exists. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on February 21, 2013, 05:12:05 AM I have an up-to-date copy of the blockchain. Is there an easy way to generate bootstrap.dat from it so I can seed it without having to download the whole thing again? This script is used to generate bootstrap.dat: https://github.com/jgarzik/pynode/blob/master/mkbootstrap.py It requires an up-to-date pynode chain database. In theory, someone could write a script that processes bitcoind's $DATADIR/blocks directory into bootstrap.dat, but no one has written that yet. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dooglus on February 21, 2013, 06:45:33 AM In theory, someone could write a script that processes bitcoind's $DATADIR/blocks directory into bootstrap.dat, but no one has written that yet. They have now... https://gist.github.com/dooglus/5002764 It uses the Armory code to do all the work, and creates a bootstrap.dat with the correct sha256 hash: $ sha256sum bootstrap.dat bf658c7055b733bfc15ea167f298c5599b89d220b14dbe7c8ef20b18e468c451 bootstrap.dat Title: Re: [ANN] Bitcoin blockchain data torrent Post by: coblee on February 21, 2013, 08:21:14 AM I've tried a few times and couldn't get this to work. First time, I just put the bootstrap.dat file there and tried to run it against my current blocks. It didn't like that and got stuck.
The next time, I deleted all my block data and tried it again. This time it got stuck at block 211551 (iirc) and wouldn't load any block after that. Looking at the debug.log, I see that my peers are trying to give me blocks higher than that but my client keeps rejecting them for some reason. The third time, I tried the same thing again. This time, when it got to block 155088, it gave me a database corrupt message and the client quit. Restarting the client does the same thing: init message: Importing blocks from block database... LevelDB read failure: Corruption: block checksum mismatch I'm running this on a Mac if that makes a difference. Seems like 0.8 is buggy. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on February 21, 2013, 08:45:01 AM I'm running this on a Mac if that makes a difference. Seems like 0.8 is buggy. Seems like your computer is sick. Run Linpack for a few hours, your computer will likely give inconsistent results, crash, hit 99 degrees C, throttle cores. http://software.intel.com/en-us/articles/intel-math-kernel-library-linpack-download A forum for it (http://www.xtremesystems.org/forums/showthread.php?175729-Lets-put-your-CPU-into-REAL-test!-Intel-Linpack-64bit&s=0a3ab56c1d284d2df9c66020190ff482) Or run this Windows software: IntelBurnTest (http://www.xtremesystems.org/forums/showthread.php?197835-IntelBurnTest-The-new-stress-testing-program) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jomplox on February 21, 2013, 07:56:56 PM Thanks for your work OP. I'm seeding the new torrent and will be doing so for at least a year at the very least.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: neofutur on February 22, 2013, 09:31:27 AM Direct download mirror: https://bitfetch.com/static/bootstrap.7z (https://bitfetch.com/static/bootstrap.7z) I also added a download on :(compressed using 7z/LZMA2 - 2.7 vs. 4.7 GiB) http://fh.gd/blockchain/ you ll find the torrent, the bootstrap.dat and the md5sum, and the same bootstrap.dat gzipped I ll try to update it whenever a new torrent and checkpoint comes out ( also seeding the torrent ) OP: perhaps you should setup a mailing list for mirrors, so you can ping us all when a new version of the torrent have to be downloaded ? Quote If you can seed, use the torrent instead. same ! prefer the torrent ! mirror sponsored by http://bitcoin.gw.gd/ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: mrlithium on March 01, 2013, 05:15:51 PM Can this be added to the sourceforge blockchain project sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/ or update that somehow?
It took me forever to find this thread. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on March 08, 2013, 07:19:06 PM Torrent file now also available via bitcoin's SourceForge page:
https://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: streblo on March 27, 2013, 09:13:35 PM I'm sure this has been discussed before, but I couldn't find it: Why isn't a (moderately up-to-date) bootstrap.dat (optionally) included with the offical bitcoind/bitcoin-qt binaries? The trust model isn't invalidated because (a) you're downloading binaries and (b) the bootstrap's data are verified. Sourceforge already hosts the blockchain. It seems it would remove a lot of redundant data transfer from the bitcoin network, no?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: cypherdoc on March 27, 2013, 09:16:17 PM i'll just say that i've been maintaining a few torrent sites since Jeff started this thread. activity was initially zilch.
in the last couple of weeks the upload bandwidth has skyrocketed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: streblo on March 27, 2013, 10:58:28 PM i'll just say that i've been maintaining a few torrent sites since Jeff started this thread. activity was initially zilch. Link?in the last couple of weeks the upload bandwidth has skyrocketed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jonathan on March 31, 2013, 08:01:15 AM same story on my box. This is the torrent that never sleeps lately.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: kuzetsa on April 24, 2013, 08:12:56 AM This is special to our use case: bootstrap.dat is essentially an append-only file. Blocks are simply concatenated onto the end. ((...snip...)) The next torrent, a few months from now, will have the same first 2,491,771,562 bytes. Thus, to bittorrent, the next torrent will simply appear to be a truncated / not fully downloaded bootstrap.dat. Bittorrent is built to fill in the missing pieces of a file, so that is what it does here :) I just copied that over from the beta thread ... wanted to point out that it DID work for me (I was able to use the older/smaller/earlier bootstrap.dat, and then my bittorrent client was able to smartly "fix" the new torrent... like... the smaller file is basically the same & I only needed to download the missing end. This procedure results in the same updated bootstrap.dat) ... it should continue to work for the next new/larger/updated torrent just the same. thanks jgarzik, you rock :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dooglus on April 24, 2013, 07:38:09 PM same story on my box. This is the torrent that never sleeps lately. Am I doing something wrong? I've been seeding for over a month, but have had very little interest in it: https://i.imgur.com/n1ptlu4.png This is in 'transmission'. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on April 24, 2013, 08:02:12 PM Am I doing something wrong? I've been seeding for over a month, but have had very little interest in it: https://i.imgur.com/n1ptlu4.png This is in 'transmission'. Me: Uploaded 23.05 GB When there are 40 seeds (there were up to 60 earlier), you only need to give one downloader 1/40th of 4.7GB, and it will be less if you have a slower connection then the fastest seeds. The three peers I have connecting from Netherlands, Russia, and Iran are barely getting data, they might be mistakenly using their 2400 baud modems to get the torrent. Make sure you have encryption enabled (many will block if you don't), and the TCP/UDP ports of bittorrent and DHT port forwarded. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 24, 2013, 08:55:35 PM Am I doing something wrong? I've been seeding for over a month, but have had very little interest in it: There tends to be bursts, with idleness following. There are many seeders, so download-then-idle is quite fast. It has the most impact in handling unintended bursts, like when bitcoin sees a lot of new press attention. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dooglus on April 25, 2013, 03:49:48 AM There tends to be bursts, with idleness following. There are many seeders, so download-then-idle is quite fast. It has the most impact in handling unintended bursts, like when bitcoin sees a lot of new press attention. My upload speed is slow and my latency is horrible. I expect most peers take one look at me and decide I'm not worth bothering with. :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: grubles on April 25, 2013, 05:00:58 AM seeding on my glorious 5 mb/s uplink.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dserrano5 on April 25, 2013, 07:24:06 AM Am I doing something wrong? I've been seeding for over a month, but have had very little interest in it: https://i.imgur.com/n1ptlu4.png This is in 'transmission'. I use transmission too and it's not rare for me to see other files uploading at hundreds of Kb/s, but I don't see a lot of interest in bootstrap.dat either. However there's little I can do besides seeding so… Title: Re: [ANN] Bitcoin blockchain data torrent Post by: takagari on April 25, 2013, 07:33:53 AM Downloading this torrent file now and uploading to my Gps seedbox.
Enjoy dont rape me too hard :P EDIT: Nope I'm not. my server won't allow public torrents :( Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dieguito on May 03, 2013, 01:21:45 AM I have an up-to-date copy of the blockchain. Is there an easy way to generate bootstrap.dat from it so I can seed it without having to download the whole thing again? This script is used to generate bootstrap.dat: https://github.com/jgarzik/pynode/blob/master/mkbootstrap.py It requires an up-to-date pynode chain database. In theory, someone could write a script that processes bitcoind's $DATADIR/blocks directory into bootstrap.dat, but no one has written that yet. Hi Jeff, I create some quicks steps to get this from the command line in Ubuntu / Debian: Code: $ sudo aptitude install rtorrent I'm not sure if the bootstrap.dat needs to go in .bitcoin or in .bitcoin/blocks/. All the best, D PS: A little OT but I see pynode is a listen only client is there something in python like pynode that handles all bitcoin operations? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: tkbx on May 06, 2013, 12:20:48 AM This is extremely convenient, when I install bitcoin-qt on another device, it takes about an hour instead of nearly a week.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: romerun on May 09, 2013, 03:02:07 AM for some reasons, I get 15 connections after using this bootstrap thing versus 8 if starts from scratch
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: plonk420 on May 28, 2013, 11:23:34 AM it's a pity the torrent isn't 7zipped...
could the next iteration of it be compressed? edit: i wouldn't mind seeding it on my seedbox, either. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on May 28, 2013, 08:51:17 PM it's a pity the torrent isn't 7zipped... could the next iteration of it be compressed? Feedback on this is welcomed. Generally, not all platforms have an easy time getting up and running with 7zip. Users in the past requested something directly usable with bitcoind. Opinions differ, and maybe if it saves a gigabyte or two, it would be worth it. Some users also complain about the doubling of disk space required -- for both compressed and uncompressed copies. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on May 28, 2013, 09:40:55 PM I would keep it uncompressed for the time being - it would be great by the way if bitcoin-qt would delete the file after a successful import automatically, I'm sure that some still keep it around unnecessarily. I see the issues with it suddenly "disappearing" but I guess the benefit of not wasting space outweighs it.
I don't care if I seed now ~4.5 GB or ~3 GB, as long as compression doesn't change the file size really significantly (meaning 5 instead of 50 or 500 GB) I rather consider it a burden than helping. There are download sources for compressed blockchain files already on the web anyways. With 0.8.2 around the corner, can we expect a new check point + torrent file by the way? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on May 29, 2013, 01:30:53 PM it's a pity the torrent isn't 7zipped... could the next iteration of it be compressed? Feedback on this is welcomed. Generally, not all platforms have an easy time getting up and running with 7zip. Users in the past requested something directly usable with bitcoind. Opinions differ, and maybe if it saves a gigabyte or two, it would be worth it. Some users also complain about the doubling of disk space required -- for both compressed and uncompressed copies. It would reduce the amount of disk space required; the decompressed copy doesn't need to be kept after an import. The compressed file is seeded from the user's torrent directory, and makes for a good checksummed archive of the blockchain for a user to have as a backup too. I wrote unzip/install scripts that can be included with the torrent for one-click extraction http://(deleted)... .... I am slowly convincing myself even more that a compressed torrent is preferable. Without compression you are downloading the same amount of data as normal p2p. The compressed binary would only be repeatable on the exact xz/lzma/7zip build version and settings, but I think there are probably four people total that have run mkbootstrap (https://bitcointalk.org/index.php?topic=130066.msg1400898#msg1400898) anyway, so this is not important. It takes about an hour to smash the blockchain down to 60% the size at the extreme settings I've used over many trials to optimize settings. Compressed-Pros: - -2000+ MB less storage used when seeding, -won't cause problems if torrent HDD is FAT32 (another: small split files easier to host/share/download from multiple sources than a single 8GB file) Compressed-Cons: -Not as simple to use, end-user must decompress with third-party utility (although 7-zip is common), -More work creating torrent (doesn't matter to end-users), -Cannot "update" torrent by simply replacing data file with newer version with additional blocks (likely to be a rare practice anyway, I am the only one seeding the old torrent right now). Here is example compression, both require about an hour (but decompress in minutes): xz utils 5.0.4/Win64, 3GB+ RAM required to compress (2,780,285,148 bytes) xz --compress --keep --format=xz --check=sha256 --verbose --lzma2=dict=256MiB,nice=273,mf=bt4 bootstrap.dat 7-zip GUI win64 - 6GB+ RAM required to compress (2,769,830,975 bytes) Format: 7z, Compression Level: Ultra, Compression method: LZMA, Dictionary size: 384MB, Word Size 273 A checkpoint of 225430 was added two months ago at the fork. I would guess that this will either be updated to a newer block or another will be added to before 0.8.2. https://github.com/bitcoin/bitcoin/blob/master/src/checkpoints.cpp Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rc0cl on June 08, 2013, 05:39:03 AM Could we have more frequent updates of these compressed files? especially the last 512MB 7zipped block.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: D35TR0Y3R on June 08, 2013, 05:51:59 AM When was this last updated?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: TLS freedom on June 08, 2013, 07:00:38 AM My setup does not like udp can someone add these trackers so they get the list. Makes no difference seed or peer. I'm looking to seed, help me help you.
http://www.h33t.com:3310/announce http://exodus.desync.com:6969/announce Title: Re: [ANN] Bitcoin blockchain data torrent Post by: TLS freedom on June 08, 2013, 05:27:35 PM Bump, can someone whos seeding or leaching this torrent add these trackers to their client, PLEASE!?
http://exodus.desync.com:6969/announce http://coppersurfer.tk:6969/announce http://www.h33t.com:3310/announce Title: Re: [ANN] Bitcoin blockchain data torrent Post by: teukon on June 08, 2013, 05:40:36 PM Bump, can someone whos seeding or leaching this torrent add these trackers to their client, PLEASE!? http://exodus.desync.com:6969/announce http://coppersurfer.tk:6969/announce http://www.h33t.com:3310/announce I added them but I'm afraid I can only leave the torrent up for 12 hours (I'm going to Australia tomorrow). I couldn't contact exodus.desync.com (no ping) but picked up a couple of peers from the other two instantly. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: TLS freedom on June 08, 2013, 06:09:54 PM Hey thanks will seed now for a few weeks, are we going to update with a new torrent every 6 months or so?
Edit: VERY FAST torrent, great job guys DL'ed it in 90min! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Insu Dra on June 08, 2013, 11:52:45 PM great learn people it's ok to mix torrents with financial data ...
On side note I'l be adding better compressed .exe file to the list pretty soon. Auto extracts to correct location and all. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rc0cl on June 09, 2013, 06:26:09 PM When was this last updated? block 216116, it is 240000+ today I am assuming the compressed bootstrap.dat differs in the headers (1st MB) and whatever is appended at the end. So I guess you need to byte compare the first chunk and the last chunk to check my assumption? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on June 10, 2013, 06:02:28 AM When was this last updated? block 216116, it is 240000+ today I am assuming the compressed bootstrap.dat differs in the headers (1st MB) and whatever is appended at the end. So I guess you need to byte compare the first chunk and the last chunk to check my assumption? A file compressed with 7zip is a solid archive with a very large dictionary. Extracting any part of the file requires the data that came before it; essentially you must have the complete 7zip archive to extract data. A multipart 7zip archive is not independent files, the parts are just a binary split of the whole large archive file, and downloading later parts without the first part is useless. You must have all 7zipped compressed data in order to extract a verifiable bootstrap.dat. A future torrent created with multi-part 7z files instead of one big uncompressed bootstrap.dat means that you could supplement your download or seeding by getting some of the torrent multi-part files off different websites where they might be hosted, and manually adding them to the torrent. I am disappointed that 0.8.2 was released without a new checkpoint. Current block is 240709, I could force the issue by creating a block 0-240,000 bootstrap.dat torrent, if many would choose to adopt and seed such a torrent as a new "official" one. I'll see if Gavin is interested in picking a new checkpoint block yet with a code pull. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on June 10, 2013, 10:13:25 AM I am disappointed that 0.8.2 was released without a new checkpoint. https://github.com/bitcoin/bitcoin/blob/master/src/checkpoints.cppLatest checkpoint: 225430 There is no need for multipart other than the 4 GB/file limit on FAT32 maybe. Most modern torrent clients already support HTTP sources too and would download pieces from these only when there are not enough seeders around in the swarm. As you already said, once a new torrent gets released, all previous data in case of 7zip is invalidated so it is not a case of "I ass another 200 MB piece and the previous ones are still valid" as it is with an uncompressed chain file. In other news, I announced to these other trackers too, though switching on DHT should already give enough peers to connect to the rest of the swarm via peer discovery - trackers are rarely used these days any more other than for bootstrapping and maybe connecting swarms that were split. Once there is even a single peer connected to both parts of a swarm, via PEX they will be soon reunited anyways. The desync.com one is offline for me too by the way. @jgarzik: Could we (until you decide on whether to compress or not) at least have an "official" bootstrap.dat torrent until 225430 (or ideally: ~240k)? I mean it's not that hard to create one ourselves, it would just lead to more fragmented swarms and just having a single "official" one makes it easier to seed. I would suggest the following scheme by the way: Every 4032 blocks (= 2 difficulty changes or ~every 4 weeks) release a new torrent link for current block - 2016 (so the block of the last difficulty change). This should be by far deep down enough to not be part of any chain splits any more and updating a link every 4 weeks (or just getting it from an RSS feed) should be not too much hassle for seeders either. If you set the part size in the torrent to a certain fixed size, you could even let people come up with the info hash programmatically just by processing their own chain files! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on June 10, 2013, 02:20:30 PM The desync.com one is offline for me too by the way. This one is a split IPv4/IPv6 tracker. IPv4 reachability seems to be determined by geolocation or some similar mechanism. IPv6 seems to be very reliable and long-term stable.Code: C:\Users\2112>ping exodus.desync.com Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on June 10, 2013, 02:37:30 PM Yes, the blockchain torrent will be updated this week (probably today).
As others have noted, if you compress with 7zip, that eliminates a useful property from the current torrent: The first X gigabytes are the same in the old bootstrap.dat torrent, and any new bootstrap.dat torrent. Using the same file, and replacing the .torrent file, will cause your torrent client to download only the new blocks, not the entire torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: TechCF on June 10, 2013, 10:26:30 PM Seeding on 30mbit, added tcp (http) trackers as requested.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on June 12, 2013, 02:46:19 PM Updated torrent. See OP for full information. The torrent is directly available from http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent but ideally the magnet should find it. As with other updates, simply replace (delete) the old .torrent with this new .torrent. Any existing bootstrap.dat will be appended, avoiding a lengthy download process for the first ~200,000 blocks. Please seed this new torrent (and drop the old)! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on June 12, 2013, 03:13:04 PM Without a tracker URL, it looks like rtorrent does not want it. Would you mind if I published a torrent.dat with some common public trackers? Well, if it is truly a problem, I would prefer to regenerate the .torrent file. What are everybody's favorite trackers? IRC also reports a couple trackers listed in the magnet link are down. Ideally the DHT should find things, but trackers seem to be necessary for some clients. Edit: rtorrent users should turn on the DHT. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on June 12, 2013, 03:23:03 PM http://istole.it/ lists 4 common open trackers. 2-3 of those seem to be giving people timeouts. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: ViperMad on June 12, 2013, 05:17:51 PM rtorrent users should turn on the DHT. The new torrent is working great with rtorrent using DHT for me. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on June 12, 2013, 05:31:00 PM OK, updated torrent file at SourceForge and http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent to add trackers mentioned upthread.
Same info hash (thus, same bootstrap.dat file data). Once enough peers have this new torrent, the magnet link should pick it up for the rest. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Chaoskampf on June 23, 2013, 10:56:16 PM I want to host the blockchain on a cloud server and then point about 50 raspberry pi's to it. Is there a way to do this?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on June 24, 2013, 12:53:54 PM I want to host the blockchain on a cloud server and then point about 50 raspberry pi's to it. Is there a way to do this? 1. Cloud server - no. To have even marginal performance, blockchain files would need to be on a local network drive. The blockchain database works much better on SSD than rotational hard drive. You would be using something much slower than a standard hard drive and sharing it with 50 computers. 2. Rasberry Pi, no. So much slower than a used $25 craigslist computer. 3. The blockchain torrent can be imported into one system's bitcoin-qt. The complete data directory (except wallet.dat) could be copied to other machines so you don't have import multiple times. 4. Then SOME of the blockchain files that never change could be moved to a network drive and replaced with symbolic links on the client filesystems. The only files that won't be changing are past BLK00001.dat-BLK00064.dat files in the blocks sub-directory. The most recent BLK000xx.dat file must not be copied to network, it will still be added to by the individual client bitcoins and must be local and unique to that bitcoin. Your question appears to have nothing to do with the bootstrap torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BitKoot on June 24, 2013, 07:27:49 PM I was just wondering if people would find it usefull if there was a website that did the following:
That's when I saw this thread :). Just downloaded the bootstap.dat in 18 minutes! What do you think, will there be enough users of a service like this? Or will a solution like this thread in combination with a 6 month interval suffice? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Darktongue on June 25, 2013, 01:14:41 AM This is iconic. I'll seed this file
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Cubic Earth on July 10, 2013, 10:07:48 PM Downloading now... started off with 11 peers and consistently over 12mbits/sec and peaking at 20mbits/sec, and that is on my 20mbit cable connection. Yep, bitcoiners know how to make any kind of P2P kick ass.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: gmaxwell on July 10, 2013, 10:30:35 PM
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on July 27, 2013, 11:11:40 AM
Offer an RSS feed as well, so seeders would just need to clear old torrents from time to time... ::)[/list] Title: Re: [ANN] Bitcoin blockchain data torrent Post by: e4xit on August 01, 2013, 06:18:15 AM So I am in the process of downloading the latest version of this torrent now, but still slightly confused as to how I use it...
I am using Bitcoin Qt 0.8.3 Beta, so it should support auto-import of this file, right? Just a little unsure of where to put it, and if I need to delete the folders "blocks" and/or "Chainstate" and the files "db.log", "debug.log" or "peers.dat"? I am on OSX so presume that it is going somewhere inside the /Users/will/Library/Application Support/ folder? Thanks Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dserrano5 on August 01, 2013, 06:57:44 AM So I am in the process of downloading the latest version of this torrent now, but still slightly confused as to how I use it... I am using Bitcoin Qt 0.8.3 Beta, so it should support auto-import of this file, right? Just a little unsure of where to put it, and if I need to delete the folders "blocks" and/or "Chainstate" and the files "db.log", "debug.log" or "peers.dat"? Put it anywhere, then run bitcoin with the "-loadblock=/path/to/file" parameter. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: e4xit on August 01, 2013, 08:48:48 AM Ok thanks. Any idea on how to do that? ::)
Edit: I am on OSX, I think I could do it on windows, but not particularly familiar with terminal and how to run apps from it with parameters in OSX Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 01, 2013, 02:10:54 PM bootstrap.dat goes into the data directory. The same directory as debug.log and peers.dat are located. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: e4xit on August 01, 2013, 05:19:01 PM Thanks for replying guys, although, the two bits of info were a little bit conflicting:
Quote Put it anywhere, then run bitcoin with the "-loadblock=/path/to/file" parameter. Quote bootstrap.dat goes into the data directory. The same directory as debug.log and peers.dat are located. I think Jeff's is just the 'safe' way, or for if you are running an older version of Bitcoin-QT... If anyone else gets stuck like me, what I did was: OSX using Bitcoin-QT versions 0.7.1+ 1) Open a terminal window 2) Open a finder window. 3) In the finder window, navigate to /Applications/ and the ctrl+click on 'Bitcoin-QT' and choose 'Show package contents' 4) Navigate to /Contents/MacOS/ and then drag the file in there ('Bitcoin-QT') into the terminal window 5) add a space into the terminal window, after the 'Bitcoin-QT' file, then type: -loadblock= So in the terminal window you will have something like this: "Your-iMac:~ user$ /Applications/Bitcoin-Qt.app/Contents/MacOS/Bitcoin-Qt -loadblock=" Dont press anything else yet... 6) Next, with the finder window selected again, navigate to the location of your 'Bootstrap.dat' file 7) Drag this file into the terminal window, so that it adds it onto the end of the command, which will look something like: "Your-iMac:~ user$ /Applications/Bitcoin-Qt.app/Contents/MacOS/Bitcoin-Qt -loadblock=/path/to/file" Hit enter to run. Hope that this helps someone else :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 01, 2013, 06:48:06 PM Simply dropping bootstrap.dat into the folder is the safe, easy way. After the import is complete, the file is renamed to ensure it is not re-imported over and over again. -loadblock is fine too, but requires a bit of extra work on the part of the user. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: e4xit on August 01, 2013, 10:16:19 PM Will Bitcoin-QT versions 0.7.1+ recognise that the file is there automagically without having to run the binary with the parameter '-loadblock='?
Also, just out of interest, does Bitcoin-QT import the blocks from disk using just a single CPU core? I am just wondering as I have an i7 (3.1 GHz) CPU, but activity monitor doesn't show more than 70% CPU (max is 800%)... If it is single core, is there any way to increase this? Thanks Title: Re: [ANN] Bitcoin blockchain data torrent Post by: snakee on August 06, 2013, 07:00:24 PM Hey ;)
Would someone be so nice and explain the following to a beginner ? ----"-loadblock=/path/to/file"---- Everything till the = i understood and i guessed, that the "path" must be the path to the bootstrap.dat ?! after that im not sure what to insert at "to" if it isnt just a to that stays there and which file is ment at the end ? It would be very nice if someone could help me out. Thank you very much in advance Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 07, 2013, 12:11:24 AM Hey ;) Would someone be so nice and explain the following to a beginner ? ----"-loadblock=/path/to/file"---- Just drop bootstrap.dat into your bitcoin data directory, restart Bitcoin-Qt, and do not be confused by other, more complicated instructions. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: snakee on August 07, 2013, 11:42:30 AM Well, thats a way i understand instantly ;)
downloaded the whole chain over night but next time ill know what to do, thx ;) but maybe someone who is bored could explain whats ment above, i like to get more knowledge ;) im the kind of person that needs to know anything i didnt understood ;) greetz from germany Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on August 07, 2013, 03:27:26 PM Well, thats a way i understand instantly ;) A little searching might get you the explanation (which links here), I'll post this linking there:downloaded the whole chain over night but next time ill know what to do, thx ;) but maybe someone who is bored could explain whats ment above, i like to get more knowledge ;) im the kind of person that needs to know anything i didnt understood ;) greetz from germany https://bitcointalk.org/index.php?topic=51456.0 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 30, 2013, 03:21:41 PM Updated block chain torrent to height 250,000, coinciding with a recently commited checkpoint in the bitcoind source code.
Existing seeders, please update by simply swapping out the old torrent file for the new torrent file. After restarting your torrent client, you should already have ~85% of the new bootstrap.dat. New seeders: We always need more seeders, in every country of the world, to help spread the block chain and speed downloads. Ideally, we have a large swarm of seeders, that burst to downloads at maximum download speed, and then remain idle the rest of the time. Read the OP for magnet link and torrent details. Ask questions. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 30, 2013, 05:42:54 PM Forgot to mention... the following python util, linearize.py, was checked into the bitcoin repo today:
https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize This tool may be used to recreate bootstrap.dat byte-for-byte identical with the bootstrap.dat in this torrent. If you are running bitcoind locally, create bootstrap.dat locally, then start seeding the torrent immediately at 100%! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Ego on September 01, 2013, 11:04:55 AM Thanks for the D/L much quicker than going through QT
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on September 09, 2013, 07:43:08 PM Bump, due to renewed interest.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on September 09, 2013, 08:26:44 PM Bump, due to renewed interest. You have my seed, sir! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: acidu on September 13, 2013, 10:24:10 AM testing this thing now... will come back for detailes... hmm.. if all OK... count me in for seed
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BaalMcKloud on September 17, 2013, 04:29:45 PM 100Mbit/s FR SeedBox added
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: DeaDTerra on October 13, 2013, 09:10:17 PM For some reason I can't get this to work.
Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on October 13, 2013, 09:22:54 PM For some reason I can't get this to work. Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Well, I've made a symlink at .bitcoin directory to bootstrap.dat, but you can just paste the file into your bitcoin config files directory. If linux: ~/.bitcoin Edit: Check here: https://en.bitcoin.it/wiki/Data_directory Title: Re: [ANN] Bitcoin blockchain data torrent Post by: DeaDTerra on October 13, 2013, 09:26:02 PM For some reason I can't get this to work. Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Well, I've made a symlink at .bitcoin directory to bootstrap.dat, but you can just paste the file into your bitcoin config files directory. If linux: ~/.bitcoin Edit: Check here: https://en.bitcoin.it/wiki/Data_directory The database directory? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on October 13, 2013, 09:39:52 PM For some reason I can't get this to work. Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Well, I've made a symlink at .bitcoin directory to bootstrap.dat, but you can just paste the file into your bitcoin config files directory. If linux: ~/.bitcoin Edit: Check here: https://en.bitcoin.it/wiki/Data_directory The database directory? Nop, paste it in the main directory, then start Bitcoin-QT it should detect the file and start importing. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on October 13, 2013, 11:30:01 PM For some reason I can't get this to work. Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Well, I've made a symlink at .bitcoin directory to bootstrap.dat, but you can just paste the file into your bitcoin config files directory. If linux: ~/.bitcoin Edit: Check here: https://en.bitcoin.it/wiki/Data_directory The database directory? Nop, paste it in the main directory, then start Bitcoin-QT it should detect the file and start importing. Nope, copy the bootstrap.dat file into the Bitcoin database directory, the same directory that contains your wallet.dat file. When you restart Bitcoin-qt, it will import all blocks from the bootstrap.dat that weren't previously downloaded. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on October 14, 2013, 01:38:43 AM For some reason I can't get this to work. Can someone kind explain the steps I need to take from that I download the file to that I import the block into the wallet? So far it doesn't seem to recognize the file until I shut the wallet off and then I get an error message. //DeaDTerra Well, I've made a symlink at .bitcoin directory to bootstrap.dat, but you can just paste the file into your bitcoin config files directory. If linux: ~/.bitcoin Edit: Check here: https://en.bitcoin.it/wiki/Data_directory The database directory? Nop, paste it in the main directory, then start Bitcoin-QT it should detect the file and start importing. Nope, copy the bootstrap.dat file into the Bitcoin database directory, the same directory that contains your wallet.dat file. When you restart Bitcoin-qt, it will import all blocks from the bootstrap.dat that weren't previously downloaded. Well, that's the main directory: $ ls .bitcoin/ blocks chainstate database db.log debug.log peers.dat wallet.dat Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bg002h on October 14, 2013, 02:47:57 AM Wow that was fast...I'm a new seed (5 Mbit/s up)...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Moebius327 on November 07, 2013, 12:32:46 PM Wow that was fast...I'm a new seed (5 Mbit/s up)... I downloaded the torrent in 65 minutes. WOW Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on November 07, 2013, 12:39:18 PM I've seeded already in total for sure above 100 GB. :)
Would be great to have a new check point and also a new torrent soon. We're already ~18k blocks further down the road after all. Please also consider creating an RSS feed that one can then subscribe to, once enough people do this, you can even swith to faster releases, as new torrents will be seeded much faster. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: michagogo on November 08, 2013, 01:31:46 PM Would be great to have a new check point and also a new torrent soon. We're already ~18k blocks further down the road after all. The checkpoints are hard-coded into the Satoshi client. New checkpoints can only happen at new releases of said client. Once that's released (or at least committed to the repo -- the timing is up to Jeff) a new torrent will presumably be made. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pointychimp on November 08, 2013, 02:37:52 PM I will download and support this.
edit: Can't get that linearize.py script to work and I haven't connected to anyone in the swarm yet. Sigh. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: botolo86 on November 13, 2013, 03:09:49 PM I am so glad I found this thread. I had Bitcoin-QT open for several days and I was still so behind in downloading the blockchain!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: michagogo on November 13, 2013, 09:24:05 PM I am so glad I found this thread. I had Bitcoin-QT open for several days and I was still so behind in downloading the blockchain! I'm beggining to think Bitcoin-QT should download the torrent itself!Well, sipa (Pieter Wuille) is working on implementing headers-first syncing, where the client will start by downloading all the block headers from a peer, and once that's done, the downloading of block data can happen in parallel from multiple peers at once, making bootstrap.dat much less needed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BaalMcKloud on November 13, 2013, 11:02:27 PM Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuantumQrack on November 16, 2013, 08:55:57 AM Never thought I would be sending the blockchain to people in Nepal. Crazy. ;D ;D ;D ;D
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rmines on November 29, 2013, 05:14:27 PM Thanks a lot for creating this torrent and all those that are seeding!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: XCASH on December 04, 2013, 12:29:10 AM Forgot to mention... the following python util, linearize.py, was checked into the bitcoin repo today: https://github.com/bitcoin/bitcoin/tree/master/contrib/misc This tool may be used to recreate bootstrap.dat byte-for-byte identical with the bootstrap.dat in this torrent. If you are running bitcoind locally, create bootstrap.dat locally, then start seeding the torrent immediately at 100%! Hi, I tried this link today, but I got a 404 file not found message. Is this download still available? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on December 04, 2013, 01:09:02 AM Forgot to mention... the following python util, linearize.py I tried this link today, but I got a 404 file not found message. Is this download still available?Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on December 04, 2013, 02:58:05 PM linearize was moved to
https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize Title: Re: [ANN] Bitcoin blockchain data torrent Post by: agent13 on December 05, 2013, 01:28:03 PM Will bitcoin-qt only recognize a bootstrap.dat file starting at block 1?
is it possible to use the python util to create a new bootstrap.dat starting at block 250001 ? For example - to update an off-line PC which has only had previous access to the 250k bootstrap.dat. Creating a new 10gb+ file up to 270k+ seems silly when I only need to create the difference between the two (and easier to transfer to off-line PC). Thanks. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: XCASH on December 05, 2013, 06:21:48 PM Thanks
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: SteamGamesBTC.com on December 06, 2013, 12:41:19 AM Will bitcoin-qt only recognize a bootstrap.dat file starting at block 1? is it possible to use the python util to create a new bootstrap.dat starting at block 250001 ? For example - to update an off-line PC which has only had previous access to the 250k bootstrap.dat. Creating a new 10gb+ file up to 270k+ seems silly when I only need to create the difference between the two (and easier to transfer to off-line PC). Thanks. Didn't test it out, but I believe this bitcoind command should be helpful for you: Code: -loadblock=<file> Imports blocks from external blk000??.dat file Cheers. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on December 06, 2013, 04:39:31 AM Will bitcoin-qt only recognize a bootstrap.dat file starting at block 1? is it possible to use the python util to create a new bootstrap.dat starting at block 250001 ? For example - to update an off-line PC which has only had previous access to the 250k bootstrap.dat. Creating a new 10gb+ file up to 270k+ seems silly when I only need to create the difference between the two (and easier to transfer to off-line PC). Thanks. Bitcoin 0.8.5 has a checkpoint block in it at 250,000 and less checks are done when downloading or importing blocks before this point. After block 250,000, download/sync/import speed is usually CPU-limited. Bitcoin looks for any file named bootstrap.dat when it starts up, imports the blocks from it, and renames it. If the blocks are duplicates, it will ignore them. If the blocks are unseen and continue from the last block, it will import them. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: agent13 on December 08, 2013, 11:42:38 PM Forgot to mention... the following python util, linearize.py, was checked into the bitcoin repo today: https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize This tool may be used to recreate bootstrap.dat byte-for-byte identical with the bootstrap.dat in this torrent. If you are running bitcoind locally, create bootstrap.dat locally, then start seeding the torrent immediately at 100%! The linearize python script does not appear to have a method to accept a starting block height. I was not sure if Bitcoin-QT would recognize a bootstrap file not starting at block height 1. But it seems it does. This appears to work - Quote def get_blocks(settings): rpc = BitcoinRPC(settings['host'], settings['port'], settings['rpcuser'], settings['rpcpass']) outf = open(settings['output'], 'wb') for height in xrange(settings['max_height']+1): if height > 249999: sys.stdout.write(str(height) + "\n") It generated a 3GB bootstrap between 250-270k which Bitcoin-QT accepted. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bg002h on December 09, 2013, 03:35:07 AM I've seeded already in total for sure above 100 GB. :) I'm up to 1 TB!I downloaded the torrent in 65 minutes. WOW And the bottleneck is probably your connection. I think this is perfectly downloadable in 10 mins.I'm over 400 GB in < 30 days...wow! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: manuel on December 09, 2013, 05:12:09 PM I'm running this on a Mac if that makes a difference. Seems like 0.8 is buggy. Seems like your computer is sick. Run Linpack for a few hours, your computer will likely give inconsistent results, crash, hit 99 degrees C, throttle cores. http://software.intel.com/en-us/articles/intel-math-kernel-library-linpack-download A forum for it (http://www.xtremesystems.org/forums/showthread.php?175729-Lets-put-your-CPU-into-REAL-test!-Intel-Linpack-64bit&s=0a3ab56c1d284d2df9c66020190ff482) Or run this Windows software: IntelBurnTest (http://www.xtremesystems.org/forums/showthread.php?197835-IntelBurnTest-The-new-stress-testing-program) I am interested in this too. I had some flakey performance at times on one of my computers. That forum has registration disabled. Any other resources where I can compare notes on temperatures and GFLOP rating, etc. to see if everything is running as it should? Thanks. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on December 09, 2013, 06:17:23 PM I'm running this on a Mac if that makes a difference. Seems like 0.8 is buggy. Or run this Windows software: IntelBurnTest (http://www.xtremesystems.org/forums/showthread.php?197835-IntelBurnTest-The-new-stress-testing-program)Title: Re: [ANN] Bitcoin blockchain data torrent Post by: manuel on December 09, 2013, 06:44:18 PM I'm running this on a Mac if that makes a difference. Seems like 0.8 is buggy. Or run this Windows software: IntelBurnTest (http://www.xtremesystems.org/forums/showthread.php?197835-IntelBurnTest-The-new-stress-testing-program)I have a mac but I was able to download this intel program from your link and run it successfully. What I'm looking for is somebody I can compare notes with on performance and operating temps. It's an intel core based mac so I suppose (but not sure?) the raw performance and operating temps should be comparable to any other computer with the same chip? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Zammo on December 09, 2013, 07:35:54 PM I have added the torrent and the magnet link to 2 of my seedboxes, both 10GBit up/down and hosted by different providers.
None of the trackers are online and I haven't been able to download or seed bootstrap.dat :( Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on December 09, 2013, 08:05:30 PM Both openbittorrent and publicbt do work for me, could it be that your "seedboxes" are not allowing BitTorrent traffic or maybe you have configured them in a way that they don't accept public torrent files/links?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Zammo on December 09, 2013, 08:22:20 PM Yep, you are right. Both providers block openbittorrent. One of the providers has just moved to a new data centre, they didn't have openbittorrent blocked in their old one :/ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on December 09, 2013, 08:25:13 PM You could query the tracker(s) manually and just add 1-2 IPs to your client, PEX takes over from there. :)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Patel on December 16, 2013, 01:29:07 AM reformated my hard drive, using the torrent to download the blockchain. thnx
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuestionAuthority on December 16, 2013, 02:13:09 AM This is nice and thanks: http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/
But what I really want to know is when you guys are going to settle on a way to prune the blockchain and implement it? Why can't full transactions be deleted from storage once all their outputs are spent if they're buried in the chain? I use Electrum on my laptop but also keep a full node 24/7 on my home server that will hopefully keep me from connecting to a cancer node. So please don't answer with that scalability simplified payment verification client block height vs. depth crap. It's a simple question. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: manuel on December 16, 2013, 09:15:13 AM I use Electrum on my laptop but also keep a full node 24/7 on my home server that will hopefully keep me from connecting to a cancer node. So please don't answer with that scalability simplified payment verification client block height vs. depth crap. It's a simple question. What's a "cancer" node? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuestionAuthority on December 16, 2013, 09:49:38 AM I use Electrum on my laptop but also keep a full node 24/7 on my home server that will hopefully keep me from connecting to a cancer node. So please don't answer with that scalability simplified payment verification client block height vs. depth crap. It's a simple question. What's a "cancer" node? Backfilling the network with clients controlled by an attacker. The attacker nodes are called cancer nodes. Always up full nodes create constant connections that resist this type of attack. If the attack network was large enough clients starting up briefly to only make one or two transactions may only connect to cancer nodes. This would effectively create two networks. Thin clients are booted up briefly to perform transactions then closed. Too many thin clients supporting the network (running briefly and closing) create an environment for this attacks success. I run a full node 24/7/365 to ensure I always connect to the "real" network. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on December 16, 2013, 02:51:12 PM But what I really want to know is when you guys are going to settle on a way to prune the blockchain and implement it? Why can't full transactions be deleted from storage once all their outputs are spent if they're buried in the chain? Bitcoin is only zero trust, if you can verify the entire transaction history. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuestionAuthority on December 16, 2013, 05:06:13 PM But what I really want to know is when you guys are going to settle on a way to prune the blockchain and implement it? Why can't full transactions be deleted from storage once all their outputs are spent if they're buried in the chain? Bitcoin is only zero trust, if you can verify the entire transaction history. I have zero trust in my bank but every transaction will not need to be verified throughout history. I only keep credit card receipts and bank statements for so many years. Why is the preservation of spent outputs so important that we will continue to allow them to make Bitcoin-Qt unwieldy? I would mind this less if I could see security enhancements that truly protect thin client or zero confirm transactions but I don't. By the way, thank you for responding and for the hard work you do. I understand how busy you are and appreciate your time. I don't want to seem like a Microsoft customer bitching at a company that's getting rich from my purchases. I began thinking about this again while downloading the blockchain torrent for a friend that I convinced to began using Bitcoin. Every time I sit at a friends desk and explain the operation of the full client the same question pops up. "When will this be done? Can I turn off my computer now?" Title: Re: [ANN] Bitcoin blockchain data torrent Post by: DeboraMeeks on December 16, 2013, 08:34:11 PM Awesome! It will help me next time.
And obviously it helps people who create a lot of bitcoind instances for themselves. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: michagogo on December 17, 2013, 04:19:57 PM I have zero trust in my bank but every transaction will not need to be verified throughout history. No, that's not true. You have 100% trust in your bank to hold your money for you. The bank says "you have this amount of money", and you believe that number. You don't control the money, the bank does. On the other hand, Bitcoin *is* zero-trust. If you run Bitcoin Core, you're validating every piece of transaction information that you receive, and not trusting or believing anything just because someone tells you it's correct. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuestionAuthority on December 17, 2013, 05:25:14 PM I have zero trust in my bank but every transaction will not need to be verified throughout history. No, that's not true. You have 100% trust in your bank to hold your money for you. The bank says "you have this amount of money", and you believe that number. You don't control the money, the bank does. On the other hand, Bitcoin *is* zero-trust. If you run Bitcoin Core, you're validating every piece of transaction information that you receive, and not trusting or believing anything just because someone tells you it's correct. No, you're completely incorrect. A bank tells YOU that you have that amount of money and YOU believe that number. I do not. Bank records and statements are accounting methods that need to be checked against your own records. If you're doing what I hope your mommy and daddy taught you when they helped you set up that shiny new first bank account, you are keeping a record of transactions (money you've spent and deposited) and reconciling that against the statement you receive from the bank each month. There is a tool I like to call a "checkbook register" to help you perform this task. That will ensure that the bank is keeping accurate records of your account and allow you to correct errors with the bank should you find an error or fraud against your account (zero trust). I have found errors in my account in the past, challenged my bank and they immediately corrected the error. If they fail to correct the error and you know they are wrong (because you don't trust them and keep your own record) you can still have the error corrected by using another tool I like to call "an attorney" to correct the error. Here is a fairly cheap book that can help you with a basic understanding of these concepts: http://www.barnesandnoble.com/listing/2691051713384?r=1&cm_mmca2=pla&cm_mmc=GooglePLA-_-Book_15To24-_-Q000000633-_-2691051713384 Record keeping should always be questioned even in Bitcoinland. However, there is a point in record keeping when the information (check register) is no longer valuable. That point is after reconciliation when the transaction is complete, it has been checked by both parties, those parties are in agreement and the information is not required for audit. It is then safe to dispose of your ledger and move on. I opened my first bank account (with the help of my mommy and daddy) in 1968. I no longer keep records of my transactions for that account because I would like to store automobiles in my garage instead of boxes of ledgers and they are unnecessary. Bitcoinland banks which are uninsured and must be trusted completely are called "Wallet Services": inputs.io, MyBitcoin, Blockchain.info etc. Online banks that are insured to $250,000 of loss and deal with fiat are just called "banks" and include: Capital One 360, USAA, Flagstar, ally etc. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: takagari on December 17, 2013, 06:15:43 PM It's to bad this is considered a public torrent, My Seed box won't allow me to seed it :(
I'm trying to figure out where the damn file goes though lol Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Patel on December 28, 2013, 05:22:25 PM How can you create your own bootstrap.dat with the latest block?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on December 28, 2013, 07:57:47 PM How can you create your own bootstrap.dat with the latest block? Just look at the previous page of posts for linearize or pynode references.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: kashish948 on January 03, 2014, 05:27:09 AM how much time does it take to "import from disk"?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 03, 2014, 06:13:38 PM a Tracker e.e. tracker.bitcoin.org would be good or a magnetlink on sourceforge
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 04, 2014, 11:47:23 AM can an Admin put an actual bootstrap.dat.torrent on SFG ? the version there is from 08/2013. my Client say 41% after import and need to download 59 % from network.
many thanks Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 04, 2014, 05:16:06 PM I guess you mean "more current", not "actual"?
Anyways, the latest check point in bitcoin's source code is from block 250000, this is what this torrent contains. If you want a more recent checkpoint, feel free to create a pull request with a more recent hash, I guess we could have an updated torrent then as well. I don't know how soon 0.9 will be released, most likely it will contain a more recent check point and this topic will be updated. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: DeboraMeeks on January 04, 2014, 08:07:07 PM Still it doesn't import all the blockchain and need a day or more to get it fully updated. Isn't there a way to add an automatically updating torrent (or a program uploading a new one every few days).
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 04, 2014, 09:33:59 PM There could be an RSS feed, usually torrent clients assume that a new item there is a completely new file though, so it would not build upon existing data and lead to a lot of redundant downloads between seeders over time. Also a concern is that there might not be enough seeders anyways, if the file changes every few days (though that's not really a concern with RSS feeds...). Also verifiability of the file might be a bit more difficult, this one is quite proven compared to something that changes often.
I guess with recent improvements (header first sync) a lot of downloading issues of the client will anyways be gone, so I'm unsure if it would pay off to invest time into a better solution for bootstrap.dat files instead of just waiting for the next bitcoin-qt release that has the potential of coming up to sync very fast anyways. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shields on January 04, 2014, 11:12:34 PM Just a thought off the top of my head... thinking of an advanced bittorrent protocol where the torrent content data can be dynamically updated. For example the original publisher of the torrent could change the contents, and any clients seeding would recognise the changes, download them and continue seeding. The original uploader could prove their identity by having a unique private key for the torrent and sign a message with the changes.
Something like this would allow something like this bitcoin torrent to be regularly updated without requiring switching from an old torrent to a new one. Does anything like this already exist? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 05, 2014, 10:40:17 AM Prorietary yes, check out btsync.
Bittorrent inc acts like huge jerks regarding open source development on that one though. Otherwise bittorrent is really intended for static files, just imagine first offering a popular file and then switching it out for something illegal or something containing a backdoor or virus as soon as it gained traction. It might be worth the time and hassle to decompile btsync and document their inner workings, to implement a open source version of it or something similar. After all it is mostly a way to share info hashes with certain nodes on the dht as far as I get it. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on January 05, 2014, 01:43:29 PM a Tracker e.e. tracker.bitcoin.org would be good or a magnetlink on sourceforge can an Admin put an actual bootstrap.dat.torrent on SFG ? the version there is from 08/2013. my Client say 41% after import and need to download 59 % from network. The latest torrent file is always available at http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/ We don't want to run a tracker ourselves.. that introduces a centralize, single point of failure. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: e4xit on January 07, 2014, 10:07:56 AM Just a thought off the top of my head... thinking of an advanced bittorrent protocol where the torrent content data can be dynamically updated. For example the original publisher of the torrent could change the contents, and any clients seeding would recognise the changes, download them and continue seeding. The original uploader could prove their identity by having a unique private key for the torrent and sign a message with the changes. Something like this would allow something like this bitcoin torrent to be regularly updated without requiring switching from an old torrent to a new one. Does anything like this already exist? This already happens with torrents, at least this torrent... When a new download for this torrent becomes available, simply choose to download to the location you still have your old "bootstrap.dat" file, you torrent client will 'verify' the first 'x'% of the data, up until the point new data is found. Then continue the download from there. I have done this myself and can verify that it works. This might only be applicable to certain data formats, for example the blockchain is extremely sequential, and data is only ever appended to the end of the file (AFAIK). But I do not know much about this an am open to correction on this matter from those who do. Note: If you have used bootstrap.dat to import block data before it will be renamed to "bootstrap.dat.old" (or something similar). If you want to perform this little 'trick', make sure it has the name "bootstrap.dat" (the same as the torrent). Would also be prudent to ensure you have bitcoind/QT shutdown while you do this, in case it start trying to import while you download or whatever. Just pointed my NL-hosted seedbox to this torrent so should have some more fast uploaders now anyway... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: kavin2468 on January 07, 2014, 11:43:50 PM I know that bitcoin has been growing a lot but mine loaded about 20-25% of the blocks with my bootstrap.dat and then stopped to switch to "synchronizing with network." Soonafter my bootstrap file was renamed to .old so I figured it was done...that bootstrap is about a half a year old, has 75% of the bitcoin trading really been in the last 6 months???
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 08, 2014, 09:16:43 AM 1000+Mbit/s FR SeedBox added
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 08, 2014, 09:19:27 AM i would make a actual bootstrap.dat and post the torrent link here.
Interrested? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 08, 2014, 05:00:24 PM I would not trust your and/or seed this file, also there are already a number of sites where you can download a more recent copy of the block chain anyways.
But I do not know much about this an am open to correction on this matter from those who do. As I said, to do this automatically, yuo need to use Bittorrent Sync, which uses BT technology but is currently closed source and in heavy development.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 08, 2014, 07:46:31 PM I would not trust your and/or seed this file, also there are already a number of sites where you can download a more recent copy of the block chain anyways. But I do not know much about this an am open to correction on this matter from those who do. As I said, to do this automatically, yuo need to use Bittorrent Sync, which uses BT technology but is currently closed source and in heavy development.you didnt need to trust because bitcoind/bitcoinqt would trust them or not... , so he would trust downloaded blocks...... anyone who trust the the bitcoinsystem can download the bootstrap.dat ( up to block 279000) from the magnetlink here: magnet:?xt=urn:btih:F01BD4AD9255447678C1C90D4FADF1BE0E8F53A4&dn=bootstrap.dat&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.publicbt.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.ccc.de%3a80%2fannounce Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 08, 2014, 09:11:27 PM IF there is actual bitcoin data in there, yes. Unless jgarzik finally gets around to extending the python script to deterministically also create torrent infohashes from blockchain data, I'd rather take no chances though.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deepceleron on January 08, 2014, 09:22:19 PM IF there is actual bitcoin data in there, yes. Unless jgarzik finally gets around to extending the python script to deterministically also create torrent infohashes from blockchain data, I'd rather take no chances though. Please publish the SHA256 & MD5 of the final bootstrap.dat file that you created to 279000. I will be able to tell you if it can be independently created by others with identical data. I can recreate jgarzik's from network-downloaded blocks. Blockchain data is fully signature-checked for all blocks since the last code checkpoint. This means that CPU, and not network bandwidth, is usually the limiting factor processing blocks 250,000 and on. It is not really beneficial to download more data before getting the Bitcoin CPU work started, which is why the torrent corresponds with the checkpoint. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 08, 2014, 09:38:03 PM IF there is actual bitcoin data in there, yes. Unless jgarzik finally gets around to extending the python script to deterministically also create torrent infohashes from blockchain data, I'd rather take no chances though. Please publish the SHA256 & MD5 of the final bootstrap.dat file that you created to 279000. I will be able to tell you if it can be independently created by others with identical data. I can recreate jgarzik's from network-downloaded blocks. Blockchain data is fully signature-checked for all blocks since the last code checkpoint. This means that CPU, and not network bandwidth, is usually the limiting factor processing blocks 250,000 and on. It is not really beneficial to download more data before getting the Bitcoin CPU work started, which is why the torrent corresponds with the checkpoint. i made my with bitcoin / contrib / linearize from bitcoin gitrepo here the sum's: md5: 8013a545e8d262a462fc33c5dd88951c bootstrap.dat SHA256: 1de3dc1a035aa82db6b75029de80a8d4fb8d4fe07ad16f085a9d30186b018b52 bootstrap.dat Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 09, 2014, 09:39:41 AM IF there is actual bitcoin data in there, yes. Unless jgarzik finally gets around to extending the python script to deterministically also create torrent infohashes from blockchain data, I'd rather take no chances though. Please publish the SHA256 & MD5 of the final bootstrap.dat file that you created to 279000. I will be able to tell you if it can be independently created by others with identical data. I can recreate jgarzik's from network-downloaded blocks. Blockchain data is fully signature-checked for all blocks since the last code checkpoint. This means that CPU, and not network bandwidth, is usually the limiting factor processing blocks 250,000 and on. It is not really beneficial to download more data before getting the Bitcoin CPU work started, which is why the torrent corresponds with the checkpoint. i made my with bitcoin / contrib / linearize from bitcoin gitrepo here the sum's: md5: 8013a545e8d262a462fc33c5dd88951c bootstrap.dat SHA256: 1de3dc1a035aa82db6b75029de80a8d4fb8d4fe07ad16f085a9d30186b018b52 bootstrap.dat update: magnet:?xt=urn:btih:F01BD4AD9255447678C1C90D4FADF1BE0E8F53A4&dn=bootstrap.dat&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.publicbt.com%3a80%2fannounce&tr=udp%3a%2f%2ftracker.ccc.de%3a80%2fannounce bootstrap.dat.torrent download: https://mega.co.nz/#!bQMR1YKQ!eix60XZmevco2kim6czKTxiPJrNBSQpNMILJRc1lpuw Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on January 11, 2014, 07:11:31 PM Updated the torrent to block 279,000. See top post. Please start seeding the new one!
For existing seeders, just swap out your .torrent file with the new one, and you will resume at ~70% completion. http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/bootstrap.dat.torrent/download Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 11, 2014, 10:17:08 PM Updated the torrent to block 279,000. See top post. Please start seeding the new one! For existing seeders, just swap out your .torrent file with the new one, and you will resume at ~70% completion. http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/bootstrap.dat.torrent/download Great work. THX. Switched my Seedboxes. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pointychimp on January 12, 2014, 01:29:59 AM The 250K bootstrap.dat saved me lots of time while I effed around with my server not realizing I was dealing with a bad hard drive. I was deleting all block data and reloading it from bootstrap.dat probably twice a day. I've overridden my global upload limit on the updated torrent so that I can help support this even better. Thank you.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: led_lcd on January 12, 2014, 10:33:51 AM Seeding with my 500 Mbps box. 8)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 13, 2014, 11:28:46 AM Add a 500 Mbps box in NL to my 1000mbps box in FR.
lets Rock Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Chancellor on January 13, 2014, 05:43:52 PM I will be another seed in 2 hours :).
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on January 13, 2014, 07:26:24 PM Suggestions for better trackers are always welcome. Trackers appear and disappear, and I'm certainly not an expert on picking them.
Ideally we would use trackerless torrents (pure DHT), but that early experiment ended in failure. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 13, 2014, 10:43:24 PM or setup an own tracker at ee bitcoin.org or so...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jonathan on January 14, 2014, 05:10:04 AM I just imported the key at http://bitcoin.org/jgarzik-bitpay.asc and then ran:
'$ gpg --verify' ... on the January 11, 2014 pgp signed text contained in the the first post of this thread. It just gave me the output: gpg: Signature made Sat 11 Jan 2014 19:04:44 GMT using RSA key ID A2DB9CCA gpg: BAD signature from "Jeff Garzik <jgarzik@bitpay.com>" Is anybody else getting this problem? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 14, 2014, 08:50:13 AM I just imported the key at the http://bitcoin.org/jgarzik-bitpay.asc and then ran: '$ gpg --verify' ... on the January 11, 2014 pgp signed text contained in the the first post of this thread. It just gave me the output: gpg: Signature made Sat 11 Jan 2014 19:04:44 GMT using RSA key ID A2DB9CCA gpg: BAD signature from "Jeff Garzik <jgarzik@bitpay.com>" Is anybody else getting this problem? Same here Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Chancellor on January 14, 2014, 09:18:09 AM gpg: BAD signature from "Jeff Garzik <jgarzik@bitpay.com>" Same hereIs anybody else getting this problem? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jonathan on January 14, 2014, 09:29:15 AM It may mean the message we are getting at the browser is not the message Jeff signed.
If this is the case, then there often winds up being an innocent explanation for it, such as that forum software is introducing unwanted line-breaks into the message, or something like that. But at worst, it may mean someone has altered the message. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 14, 2014, 10:00:18 AM Maybe it would be better if jgarzik would wrap the statement in [ code ] tags
Code: like this Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on January 14, 2014, 10:59:26 AM Updated OP to use a code block, and also posted the original GPG-signed msg at http://gtf.org/garzik/bitcoin/torrent-msg.txt
Let me know if sigs still fail. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jonathan on January 14, 2014, 11:07:49 AM Hi Jeff,
This one gives a good sig: http://gtf.org/garzik/bitcoin/torrent-msg.txt ... but the code block in this thread's OP is still bad. Diff check shows a line break at line four in the good message (ie., the file at gtf.org), whereas line four in this thread's OP code block goes straight to the text. Thanks for attending to this Jeff. :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 15, 2014, 09:35:33 PM 24 hours / 90 GB uploadet with my seedbox :-)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Subo1977 on January 23, 2014, 02:56:49 PM I add a new Torrent to my seeders:
A Bootstrap.dat containing the Blocks from 279000 to 282000 ( 460 MB). Here the Magnet: magnet:?xt=urn:btih:6BDE914DB48DA35A2F9AFD5B08B4DC1DFF7DBA5B&dn=bootstrap_279000_up.dat&tr=http%3a%2f%2ftracker.ex.ua%2fannounce&tr=udp%3a%2f%2ftracker.publicbt.com%3a80%2fannounce&tr=http%3a%2f%2fcoppersurfer.tk%3a6969%2fannounce&tr=http%3a%2f%2ftracker.ex.ua%3a80%2fannounce&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=http%3a%2f%2fi.bandito.org%2fannounce&tr=http%3a%2f%2ftracker.marshyonline.net%2fannounce&tr=http%3a%2f%2fexodus.desync.com%2fannounce&tr=udp%3a%2f%2ftracker.ex.ua%3a80%2fannounce&tr=http%3a%2f%2ftracker.tfile.me%2fannounce and here is the .torrent https://github.com/Subo1978/Bootstrap.dat Have fun Title: Re: [ANN] Bitcoin blockchain data torrent Post by: StewartJ on January 29, 2014, 11:50:45 PM I add a new Torrent to my seeders: A Bootstrap.dat containing the Blocks from 279000 to 282000 ( 460 MB). Here the Magnet: magnet:?xt=urn:btih:6BDE914DB48DA35A2F9AFD5B08B4DC1DFF7DBA5B&dn=bootstrap_279000_up.dat&tr=http%3a%2f%2ftracker.ex.ua%2fannounce&tr=udp%3a%2f%2ftracker.publicbt.com%3a80%2fannounce&tr=http%3a%2f%2fcoppersurfer.tk%3a6969%2fannounce&tr=http%3a%2f%2ftracker.ex.ua%3a80%2fannounce&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80%2fannounce&tr=http%3a%2f%2fi.bandito.org%2fannounce&tr=http%3a%2f%2ftracker.marshyonline.net%2fannounce&tr=http%3a%2f%2fexodus.desync.com%2fannounce&tr=udp%3a%2f%2ftracker.ex.ua%3a80%2fannounce&tr=http%3a%2f%2ftracker.tfile.me%2fannounce and here is the .torrent https://github.com/Subo1978/Bootstrap.dat Have fun Quick question: if we have already synced up to 279k blocks with our qt wallet, can we use your bootstrap_279000_up.dat file by itself to update the remaining blocks? Or do we also need the entire bootstrap.dat additionally with previous blocks? Thanks for your help! Stewart EDIT: This does work with the partial bootstrap file. I just had to make sure to re-start the wallet after adding the bootstrap file. Normally, I would be waiting for hours get these last 4k blocks synched in the wallet, now its just taking a few minutes. Thanks for the bootstrap file!!! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Shahrukh on February 08, 2014, 07:33:06 PM Where am I supposed to copy this bootstrap file first I did it in ~/.bitcoin folder and then ~/.bitcoin/database nothing makes any effect let me tell you I copied this file when bitcoin already synchronized few thousand blocks
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: boiron on February 12, 2014, 07:24:36 AM Where am I supposed to copy this bootstrap file first I did it in ~/.bitcoin folder and then ~/.bitcoin/database nothing makes any effect let me tell you Place bootstrap.dat in the bitcoin data directory and then start Bitcoin-Qt. It will read the file to create the blockchain. The file will be renamed to bootstrap.dat.old when this is completed to prevent reprocessing when Bitcoin-Qt is restarted. You can locate the data directory by reading this (https://en.bitcoin.it/wiki/Data_directory). From : http://bitcoin.stackexchange.com/questions/19097/connecting-bootstrap-dat-to-bitcoin-qt I copied this file when bitcoin already synchronized few thousand blocks You can use the bootstrap.dat torrent with no ill effects regardless of your current block. When you restart and Bitcoin sees the bootstrap.dat that you have dropped in it's data directory, any block hashes you already have will be skipped quickly, and the import will pick up at the blocks you don't have. From this current post (https://bitcointalk.org/index.php?topic=145386.msg1543845#msg1543845) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: wwdz99 on February 13, 2014, 06:39:15 AM hi all
i download the torrent file ,but last long time the bootstrap.dat file couldnot be down complete. now the downloaded rate about 70%,why? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Drai on February 14, 2014, 09:09:45 PM I'm downloading
Thank you all. It looks like a lot of time saved using them for more than a pc. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jongameson on February 14, 2014, 10:57:45 PM you could make a shipload of money
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Shahrukh on February 15, 2014, 02:01:32 AM Where am I supposed to copy this bootstrap file first I did it in ~/.bitcoin folder and then ~/.bitcoin/database nothing makes any effect let me tell you Place bootstrap.dat in the bitcoin data directory and then start Bitcoin-Qt. It will read the file to create the blockchain. The file will be renamed to bootstrap.dat.old when this is completed to prevent reprocessing when Bitcoin-Qt is restarted. You can locate the data directory by reading this (https://en.bitcoin.it/wiki/Data_directory). From : http://bitcoin.stackexchange.com/questions/19097/connecting-bootstrap-dat-to-bitcoin-qt I copied this file when bitcoin already synchronized few thousand blocks You can use the bootstrap.dat torrent with no ill effects regardless of your current block. When you restart and Bitcoin sees the bootstrap.dat that you have dropped in it's data directory, any block hashes you already have will be skipped quickly, and the import will pick up at the blocks you don't have. From this current post (https://bitcointalk.org/index.php?topic=145386.msg1543845#msg1543845) Thanks for the help later on I figured out that my bitcoin daemon was older version which does not support sync with bootstrap I upgraded now and everything works fine Title: Re: [ANN] Bitcoin blockchain data torrent Post by: roslinpl on February 16, 2014, 12:08:33 AM I will be another seed in 2 hours :). I will be another seed in 2 hours :). Hehe :) nice idea! :) Torrent the blockchain! :) Nice. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: KyrosKrane on February 16, 2014, 09:13:01 PM Direct download mirror: https://bitfetch.com/static/bootstrap.7z (https://bitfetch.com/static/bootstrap.7z) Just a note, your SSL certificate expired at end of January. The site now pops up scary messages about untrusted connections if you try to download the file. :((compressed using 7z/LZMA2 - 2.7 vs. 4.7 GiB) If you can seed, use the torrent instead. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Lauda on February 20, 2014, 12:20:50 AM This was needed, took me 20 hours to sync completely from the start.
Keep updating it. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: infofront on February 20, 2014, 11:58:22 PM So I downloaded this blockchain torrent and and ran bitcoind in a screen session on Sunday. A line of "y"s kept running down my screen, as if it's checking the file block by block? Anyway, I typed "ps aux" and it says that a procees called "YES" was using up almost 100% of one core, and screen was using up 56% of another.
I just checked in on my VPS, and the thing is still maxing out almost 2 cores. Does anyone know what could be happening here? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: awesomeami on March 02, 2014, 03:19:41 AM pls make this thread sticky
or @ least EDIT this https://bitcointalk.org/index.php?topic=252937.msg2690447#msg2690447 (https://bitcointalk.org/index.php?topic=252937.msg2690447#msg2690447) and include this: https://bitcointalk.org/index.php?topic=145386.msg1542831#msg1542831 (https://bitcointalk.org/index.php?topic=145386.msg1542831#msg1542831) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: awesomeami on March 02, 2014, 03:26:13 AM Seeding with my 500 Mbps box. 8) Add a 500 Mbps box in NL to my 1000mbps box in FR. lets Rock can u provide link pls? to ISP/hosting Co. ty I wanna buy&pay&share&help. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: awesomeami on March 02, 2014, 03:32:12 AM Forgot to mention... the following python util, linearize.py, was checked into the bitcoin repo today: reminderhttps://github.com/bitcoin/bitcoin/tree/master/contrib/linearize This tool may be used to recreate bootstrap.dat byte-for-byte identical with the bootstrap.dat in this torrent. If you are running bitcoind locally, create bootstrap.dat locally, then start seeding the torrent immediately at 100%! + can u pls update OP, so every1 can use it? ty 4 da tool Title: Re: [ANN] Bitcoin blockchain data torrent Post by: natenjo on March 02, 2014, 09:27:04 AM If anyone can't use Torrents (thank you to my ISP..), but maybe has a Premium service (like premiumize.me, which also accept Bitcoin) you can Download the blockchain.dat here
http://uploaded.net/file/unaf0k07/bootstrap.part10.rar http://uploaded.net/file/4rr7h1m0/bootstrap.part09.rar http://uploaded.net/file/47ahu1lp/bootstrap.part08.rar http://uploaded.net/file/8nrhh5pz/bootstrap.part07.rar http://uploaded.net/file/m9nliz9z/bootstrap.part06.rar http://uploaded.net/file/7flq44wp/bootstrap.part05.rar http://uploaded.net/file/j54ewvqw/bootstrap.part04.rar http://uploaded.net/file/wei37exp/bootstrap.part03.rar http://uploaded.net/file/hl9p671r/bootstrap.part02.rar http://uploaded.net/file/ff90o09w/bootstrap.part01.rar Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Paladino on March 06, 2014, 12:25:17 AM Backup here from the Torrent directly: http://uptobox.com/96wymisfbixf
For people who want to know about ISP in France providing 1Gbit/s home connection, it depends your location, if you are an enterprise, etc.. but you can check with FREE.FR, ORANGE.FR, NUMERICABLE.FR, etc. Some also offer VPS, you can see with OVH.com Title: Re: [ANN] Bitcoin blockchain data torrent Post by: phrackage on March 13, 2014, 02:19:23 PM The problem with these torrents is that the peers can be seeding out of date versions. People have to manually notice an updated torrent and go download that instead. If we used Bittorrent Sync (http://www.getsync.com) then a highly trusted member of the community could have the main 'secret' and everyone else who just wants to download can have the 'read-only secret'.
In fact that trusted member can also share it with a couple of other trusted members, so that any of a small group of people could update the bootstrap.dat, whereas the usual peers could only get the updates. Like this, the file can just be updated and all the peers will notice and update their copy, downloading only the chunks that are different/new. No new torrent needs to be distributed or freshly seeded. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on March 13, 2014, 04:21:13 PM Sync is a closed proprietary system. No way I'm seeding anything there or even touch that binary.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: felipelalli on March 18, 2014, 09:07:23 PM I can't verify the signature of the original post. Why?
Code: felipelalli:tmp/ $ gpg --verify ~/tmp/jeff [18:04:06] Title: Re: [ANN] Bitcoin blockchain data torrent Post by: felipelalli on March 18, 2014, 09:16:10 PM Well... From http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/bootstrap.dat.torrent.gpg/download (http://sourceforge.net/projects/bitcoin/files/Bitcoin/blockchain/bootstrap.dat.torrent.gpg/download) I found a good signature.
Code: felipelalli:~/ $ gpg --verify tmp/bootstrap.dat.gpg [18:14:44] Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on March 19, 2014, 02:45:37 AM It seems like pasting from the OP confuses PGP.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: felipelalli on March 19, 2014, 10:40:34 AM Thank you! Could you try to verify the original post to see if it is a copy/paste problem or if it was hacked or something like that? I know is highly improbable, but I already saw everything in Bitcoin world.
Thank you again! Felipe. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jsgayo on March 19, 2014, 03:12:26 PM Seeding this as much as possible! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on March 19, 2014, 07:23:37 PM Yes, "moar please"! Seeding is very helpful on release day, of all days.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: escrowguy on March 19, 2014, 09:42:11 PM i'll just say that i've been maintaining a few torrent sites since Jeff started this thread. activity was initially zilch. link?in the last couple of weeks the upload bandwidth has skyrocketed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kazimir on March 20, 2014, 01:18:32 PM Does Bitcoin Core 0.9.0 support (recognize) newer bootstrap data, beyond 279000 blocks?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on March 20, 2014, 03:19:50 PM Does Bitcoin Core 0.9.0 support (recognize) newer bootstrap data, beyond 279000 blocks? All bitcoin versions recognize any valid block. If you build your own bootstrap.dat, it can go beyond 279000 blocks, yes. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on March 20, 2014, 03:22:36 PM Maybe it is soon time for a new checkpoint or at least updated bootstrap file? There has been over 1 GB of transactions since the last one in January and that takes already quite some time to get and verify for new nodes...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on March 20, 2014, 05:17:57 PM The rough standard is an update every 3 months or so, out of an over-abundance of caution.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kazimir on March 21, 2014, 10:45:34 AM Does Bitcoin Core 0.9.0 support (recognize) newer bootstrap data, beyond 279000 blocks? All bitcoin versions recognize any valid block. If you build your own bootstrap.dat, it can go beyond 279000 blocks, yes.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: roy7 on March 30, 2014, 04:04:33 PM Is this the same torrent the official web site links at https://bitcoin.org/bin/blockchain/bootstrap.dat.torrent ?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BaalMcKloud on March 30, 2014, 08:23:30 PM Is this the same torrent the official web site links at https://bitcoin.org/bin/blockchain/bootstrap.dat.torrent ? checked...it is Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 01, 2014, 03:41:09 AM Is this the same torrent the official web site links at https://bitcoin.org/bin/blockchain/bootstrap.dat.torrent ? Yes. bitcoin.org will be the new official site. It was "soft launched" (without announcement) as I was travelling and did not have time to adequately test, and then make updates. It is also about time to roll another torrent. I've also been considering adding a second torrent, which contains blocks/blk*.dat as you might find created by Bitcoin Core. New installations could download this blk*.dat torrent, restart with "-reindex" option. This will perform a zero-trust revalidation of all data, while eliminating the redundant copy of the bitcoin data (vs. bootstrap.dat). Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 14, 2014, 03:33:20 AM Calling for pre-seeding of the new bootstrap.dat torrent: http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent
The old 14G bootstrap.dat is 81% of the new 17G one, so remember not to erase the old file. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BaalMcKloud on April 14, 2014, 10:58:05 AM Calling for pre-seeding of the new bootstrap.dat torrent: http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent The old 14G bootstrap.dat is 81% of the new 17G one, so remember not to erase the old file. 100Mbit/s and 250Mbit/s+ Root added for seeding Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 14, 2014, 05:15:59 PM The new torrent is now ready for public release.
Read the updated OP, and seed away! Remember to reuse your old bootstrap.dat, which will start the new torrent at 81% (14G) of the new 17G torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: FreddyFender on April 14, 2014, 07:03:24 PM 81%
!!!!!!!!!!!!!!!! thx Jeff! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sledge on April 14, 2014, 07:48:25 PM Could someone explain why it is preferable to seed a torrent of the blockchain rather than just run a bitcoin full node? I run a full node and it sends between 500GB to 1TB a month of data to at least 70-95 connected clients. Yes, I opened port 8333 on the firewall/router.
Am I doing it wrong? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 14, 2014, 08:21:45 PM Could someone explain why it is preferable to seed a torrent of the blockchain rather than just run a bitcoin full node? I run a full node and it sends between 500GB to 1TB a month of data to at least 70-95 connected clients. Yes, I opened port 8333 on the firewall/router. It is preferable to run a full node. The torrent is a workaround until "headers first sync" is implemented, at which point, it will be faster to download from the P2P network. Today, the torrent makes some client syncs faster, and also lessens the load on the P2P network. It is more useful for the P2P network to be used for distributing recent information. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: grahvity on April 14, 2014, 10:29:28 PM Holy crap! It's the fastest torrent I never downloaded
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 15, 2014, 07:34:59 AM Holy crap! It's the fastest torrent I never downloaded hehe, good! The idea is to get many long-term seeders. If we have enough, most downloaders will see an immediate, fast download. The torrent remains idle the rest of the time. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on April 15, 2014, 08:51:36 AM https://s3.amazonaws.com/bitcoinarmory-media/announce.txt seems to contain the link to their bootstrap torrent file. They plan to change it every 2-4 weeks though and have a handful of seedboxes they pay themselves... Also they use a central tracker and set the private bit on their torrent file, so there will be no DHT or PEX for clients who respect this (most do). To me this sounds more like a way to track Armory users and a privacy risk than anything else, I'd advise against seeding the Armory torrent "for fun" or to help them out unless you know what you're getting into.
Anyways, this could be made MUCH easier for everybody involved if people would actually read up a bit on RSS feeds for torrents! /rant Title: Re: [ANN] Bitcoin blockchain data torrent Post by: escrowguy on April 20, 2014, 11:39:53 PM best torrent ever 8)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: billysweird on April 21, 2014, 12:58:11 AM I'm downloading. Thank you.
But it looks like a lot of time saved using them for more than a pc. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rgenito on April 21, 2014, 09:54:32 PM does this bootstrap work on all Bitcoin Core platforms? (Windows, Linux, OSX...)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on April 21, 2014, 10:07:40 PM It is the same blockchain everywhere, so yes.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: QuantumQrack on May 10, 2014, 07:56:24 AM Block 300,000. New torrent time?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: AtomicDoge on May 10, 2014, 02:55:48 PM Very important release here, thanks for this.
This change to 0.8.0 is sure to save terabytes around the net, I can't wait to understand how Bitcoin works again though since I thought we needed the chain... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dan14941 on May 22, 2014, 12:45:24 PM add these trackers!
Code: udp://tracker.openbittorrent.com:80 Plz Title: Re: [ANN] Bitcoin blockchain data torrent Post by: levino on May 25, 2014, 03:53:20 PM Can anyone just give me a command for ubuntu to dump the blk* files into a bootstrap.dat file? I had such an example somewhere on the net but I am not able to find it anymore... Thanks!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: illymoka on May 25, 2014, 04:15:44 PM I think the big question is, is there a way to make the default client act more like bittorrent when syncing? If someone can't mine at least they can let lots of people use their bandwidth.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: illymoka on May 25, 2014, 04:22:06 PM If bittorrent is faster, that says to me that the client should be faster, thus giving lower speed connections the chance to run a full client.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: LesterTheEight on May 25, 2014, 08:35:27 PM Is there a point to this torrent now that bitcoind block verification is optimized?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: adaseb on May 25, 2014, 09:22:41 PM The good thing about this is that it reduces the CPU load also. Whenever downloading the data my CPU is running at 80% analysing the data.
Takes like 1 day to download and the computer can't be used. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on June 07, 2014, 11:06:25 AM It's time for an update of this.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on June 07, 2014, 04:44:22 PM Thanks! Can you tell me how you can make a torrent from blockchain databases?
Kindly, Muhammed Zakhir Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Catmoonglow on June 07, 2014, 04:48:38 PM This would have been really fucking nice like 2 months ago.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on June 08, 2014, 09:49:11 PM Thanks! Can you tell me how you can make a torrent from blockchain databases? Read the first post in this thread... especially the section titled "Generate the file myself?".Kindly, Muhammed Zakhir Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on June 14, 2014, 10:29:37 PM Right now anyone setting up a new client with this torrent will have to update over 10800 blocks the slow way.
We should be updating this torrent every 5000 blocks or so. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2bluesc on June 15, 2014, 04:13:47 AM Right now anyone setting up a new client with this torrent will have to update over 10800 blocks the slow way. We should be updating this torrent every 5000 blocks or so. If it's updated often enough, an RSS feed pointing to the torrent or magnet link some how would be handy to update bittorrent clients. Don't know much about RSS feeds, but I've seen it in the past. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on July 04, 2014, 06:41:46 PM Looks like update needed :)
I made a linear block chain up to 309000, 7zip it and put into torrent. It is like 12,3GB. My home upload is ~500kb/s so it will take some time to move it to better seeds... hopefully one day tops :) magnet link: Code: magnet:?xt=urn:btih:8347fcc3df300e5a31e2304442c128e308256dfc&dn=bitcoin309000&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80&tr=udp%3a%2f%2ftracker.publicbt.com%3a80&tr=udp%3a%2f%2ftracker.istole.it%3a80%2fannounce&tr=udp%3a%2f%2fopen.demonii.com%3a1337 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on July 04, 2014, 07:02:53 PM No change to https://github.com/bitcoin/bitcoin/blob/master/src/checkpoints.cpp, no change to this file.
I'm not going to seed some random stranger's torrent, sorry. That being said, yes, it really could use an update + new checkpoint... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on July 04, 2014, 07:11:16 PM Good point!
It is my torrent. I just made it and seed it on my machine. If your torrent is showing up IPs you can see it is rav3n.dtdns.net :) But if you not need/want it - do not download! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on July 06, 2014, 05:12:25 PM I'm not going to seed some random stranger's torrent, sorry. If you connect a full node to the bitcoin network you also download data from random strangers. As I understand it the data in this file is subjected to exactly the same checks as data downloaded by the bitcoin client itself. Should the data be misformatted it will be rejected. If some of the end blocks got reorganized the client will sort it out once it connects to the network proper. Of course you are right to be paranoid but I don't see the need for this torrent to align with checkpoints in the code itself. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on July 06, 2014, 05:41:02 PM After checkpoints there is little need to get data from a torrent file instead of the network itself, since it is likely a CPU or disk IO bound operation, not network speed.
Also with this other torrent file, there is no way for me (other than downloading the whole file and decompressing it) to recreate + verify it locally. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: EpptEinK on July 07, 2014, 11:40:22 AM Hey, thanks for the torrent. I downloaded the file and placed it in my btc folder. I open the client and it says its importing the block from the disk, but nothing hapens, it still says 0 out of 309616 blocks processed. It´s been like that for 1 hour. Is this normal? Thank you :)
EDIT: OK, its now syncronizing and the bootstrap.dat changed the name to bootstrap.dat.old, still at 0 blocks... NEW EDIT: It doesnt sync, what should I do? Thanks. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on July 07, 2014, 12:31:12 PM After checkpoints there is little need to get data from a torrent file instead of the network itself, since it is likely a CPU or disk IO bound operation, not network speed. Also with this other torrent file, there is no way for me (other than downloading the whole file and decompressing it) to recreate + verify it locally. Network speed is an issue, that's why we are using a torrent. There are currently 14620 blocks between the end of this torrent and the end of the blockchain. Bitcoind should download about as fast as torrent does, but sadly it doesn't. Bitcoind verifies this data when it imports it, just like when it verifies data it pulls off random network nodes. The only possible attack is a 50%+1, and if an attacker could pull that off they would do it on the main network, or more likely they would just mine half the coins instead. EDIT: For clarity Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on July 07, 2014, 01:23:02 PM The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on July 09, 2014, 08:36:04 AM The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually. Experimentation being the basis of science I tested your theory. I used a AWS m3.xlarge with a 60GB SSD block device for the bitcoin client. I created a bootstrap.dat for block 305000 and compared the time it takes to update from block 295000 to 305000 via my bootstrap.dat and by pulling blocks from the live network. It turns out you are right. Time to update from 295000 to 305000 with a custom bootstrap.dat: 3845 seconds Time to update from 295000 to 305000 by connecting to the live network: 3848 seconds As a 3 second difference on a 1 hour load is meaningless I can only conclude there is no reason to update this torrent. I'll keep throwing bandwidth at it. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: DeeBo on July 10, 2014, 09:18:50 AM The verification speed when verifying blocks past the latest checkpoint is far slower than getting the blocks from the network usually. Experimentation being the basis of science I tested your theory. I used a AWS m3.xlarge with a 60GB SSD block device for the bitcoin client. I created a bootstrap.dat for block 305000 and compared the time it takes to update from block 295000 to 305000 via my bootstrap.dat and by pulling blocks from the live network. It turns out you are right. Time to update from 295000 to 305000 with a custom bootstrap.dat: 3845 seconds Time to update from 295000 to 305000 by connecting to the live network: 3848 seconds As a 3 second difference on a 1 hour load is meaningless I can only conclude there is no reason to update this torrent. I'll keep throwing bandwidth at it. One flaw in your test: I'm pretty sure when you give the Bitcoin client a bootstrap.dat file it doesn't just "update" but instead rescans the entire blockchain database on your hard drive. That's why the bootstrap.dat is meant to be used on a fresh install because if you already have a good chunk of the blockchain downloaded you're usually better off just letting the client update from the network. Also not everyone has the bandwidth of an extra large AWS instance. With my slow 3mbps/384kbps DSL line, I may be the exception in that I could possibly rebuild my local database faster than I could download the latest blocks. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on July 15, 2014, 01:40:00 PM One flaw in your test... I didn't go into exact details about how I tested because discussions like this tend to never end. If there was a significant advantage or disadvantage to using the torrent I think I would have seen it. Please do treat my results with scepticism and test yourself. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: giveBTCpls on July 15, 2014, 02:17:01 PM Would be too much to ask if they added like, not daily but maybe weekly updated blockchain file? Everytime someone new comes to Bitcoin, the first thing they say is how much of a pain in the ass it is to sync, unless they are using 3rd party wallets that is, but im too used to the simple niceness of the classic wallet to change :)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on July 15, 2014, 06:20:27 PM Looks like update needed :) Looks like at least 10 ppl downloaded it but noone seed? :/I made a linear block chain up to 309000, 7zip it and put into torrent. It is like 12,3GB. My home upload is ~500kb/s so it will take some time to move it to better seeds... hopefully one day tops :) magnet link: Code: magnet:?xt=urn:btih:8347fcc3df300e5a31e2304442c128e308256dfc&dn=bitcoin309000&tr=udp%3a%2f%2ftracker.openbittorrent.com%3a80&tr=udp%3a%2f%2ftracker.publicbt.com%3a80&tr=udp%3a%2f%2ftracker.istole.it%3a80%2fannounce&tr=udp%3a%2f%2fopen.demonii.com%3a1337 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on July 15, 2014, 09:53:54 PM Would be too much to ask if they added like, not daily but maybe weekly updated blockchain file? Everytime someone new comes to Bitcoin, the first thing they say is how much of a pain in the ass it is to sync, unless they are using 3rd party wallets that is, but im too used to the simple niceness of the classic wallet to change :) There isn't a 'they', there is only an 'us'. If you think it should be done then do it. I was going to but my tests showed that using a bootstrap file doesn't load data into bitcoind any faster than pulling the data from the live network for blocks beyond 295000. The recent blocks seem more complicated than earlier ones. Maybe a bigger bootstrap file would still be useful to some people. I really think that most users should be using a light client like electrum anyway. Interested companies, organizations, and technical users should be running the full nodes, not every guy who wants to make small purchases. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: georgem on July 15, 2014, 11:15:28 PM I am checking this out now.
A month ago it took me about a day to download the whole blockchain with the wallet. I will see how fast the torrent and validating is. At the moment it's very promising, like 25 MB/s download speed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: georgem on July 15, 2014, 11:26:43 PM Alright. It took 26 minutes to download.
Now starting the wallet.. It says it's importing data.... fine... 10 minutes in... it has imported about 170'000 blocks.... 1 hour later ... 230k blocks. 1.5 hours later .... importing block 250k.... importing sure takes a lot of time... :( but we are getting there... 2 hours, 270k (that's end of november 2013)... at this rate it should take another hour to finish... I was wrong... 3 hours, it's at 283k... I give up... I have to get some sleep... lol... PS progress bar is at about 40%... but don't think its an accurate estimation of time needed. But if it is, then it might take another 3-4 hours to stop.... will see tomorrow... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: georgem on July 16, 2014, 06:21:26 AM 7 weeks to go.
it took 7 hours to get here. It'll probably finish now in a 1 hour or so... Now it switched to synchronizing with network for the remaining blocks that weren't in the torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on July 16, 2014, 10:46:46 AM Alright. It took 26 minutes to download. Now starting the wallet.. It says it's importing data.... fine... 10 minutes in... it has imported about 170'000 blocks.... 1 hour later ... 230k blocks. 1.5 hours later .... importing block 250k.... importing sure takes a lot of time... :( but we are getting there... 2 hours, 270k (that's end of november 2013)... at this rate it should take another hour to finish... I was wrong... 3 hours, it's at 283k... I give up... I have to get some sleep... lol... PS progress bar is at about 40%... but don't think its an accurate estimation of time needed. But if it is, then it might take another 3-4 hours to stop.... will see tomorrow... You can use this command for increasing syncing speed from your computer not from internet. :) Code: -dbcache=<n> Set database cache size in megabytes (4 to 4096, default: 100) You can use this command to decrease the connection to number of peers, if it is affecting your internet browsing. Code: -maxconnections=<n> Maintain at most <n> connections to peers (default: 125) Kindly, MZ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on July 31, 2014, 02:39:36 PM Beta-testing and pre-seeding a new torrent at http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent
Please only join if you already have an old bootstrap.dat file, or you built the new one yourself using linearize.py (https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize) and bitcoind. Code: magnet link: Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on July 31, 2014, 05:30:08 PM Does tracker.ccc.de work for anyone anywhere in the world besides .at, .ch & .de?
Edit: After reviewing the recent statistics of reach-ability of demonii.com I no longer recommend it. What about other trackers? Open, less politicized, trackers, that aren't associated with thepiratebay.se? Or maybe differently politicized trackers associated with other organizations? While those 4 trackers are reliable and well defended against DDoS, they are also the ones that are most commonly blocked/censored/filtered by various software nannies. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on July 31, 2014, 07:53:49 PM What about other trackers? Open, less politicized, trackers, that aren't associated with thepiratebay.se? Or maybe differently politicized trackers associated with other organizations? While those 4 trackers are reliable and well defended against DDoS, they are also the ones that are most commonly blocked/censored/filtered by various software nannies. I don't pretend to be a tracker expert, and actively solicit suggestions. I would certainly bias towards less politicized + more reliable trackers. Please post your tracker suggestions. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: ddrown on July 31, 2014, 09:22:37 PM Since I was curious about the new torrent, here's some info:
new bootstrap.dat contains up to block height 313000 (July 8 ) The new block data (this is using the hexidecimal form) matches my bitcoind's: $ ./blockheight -l 295001 < bootstrap-313000.dat | sha256sum 6cccd54b215799d91b6781b190903fb5673cf6413d2a93c5ebe26223e3b2de21 - $ for((i = 295001; i < 313001; i++)); do ./bitcoin-cli getblock `./bitcoin-cli getblockhash $i` false ; done | sha256sum 6cccd54b215799d91b6781b190903fb5673cf6413d2a93c5ebe26223e3b2de21 - Previous data matches: $ dd if=bootstrap-313000.dat bs=335633 count=52206 2>/dev/null | sha1sum 78a4b41ba7ed823c78cd9ca81a6de393c0ccc226 - $ sha1sum bootstrap-295000.dat 78a4b41ba7ed823c78cd9ca81a6de393c0ccc226 bootstrap-295000.dat Can you re-add a http:// based tracker? The UDP trackers aren't supported by older transmission (2.13 from EPEL). The exodus.desync.com tracker in the previous torrent seems to be working well. Edit: UDP trackers actually do support IPv6, but support varies depending on your torrent software. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rme on July 31, 2014, 10:16:49 PM Seeding new torrent 24/7
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on July 31, 2014, 10:45:19 PM I don't pretend to be a tracker expert, and actively solicit suggestions. I nominate two trackers that are open, differently politicized and seem to work reliably globally.I would certainly bias towards less politicized + more reliable trackers. Please post your tracker suggestions. http://bttracker.crunchbanglinux.org:6969/announce If you are changing trackers in your torrent, please From the other trackers that were used in the past: h33t.com domain is disabled by a complex legal issue and won't be back for a while. I'm not a torrent&tracker expert either, but have fresh experience troubleshooting these problems for the others. Edit: The exodus.desync.com tracker in the previous torrent seems to be working well. No, please don't. This is an example of dual-stack IPv4+IPv6 tracker that causes problems to many Windows users. Modern Windows versions support IPv6 out-of-the-box via Teredo tunnels and this just causes trouble and confuses the beginning users. The IPv4 side of this tracker is not globally accessible, some big European ISPs are on their block-list. Edit2: Upon further review of the recent torrent statistics in Windows I'm going to advise against using open.demonii.com. Again the problem is dual stack IPv4+IPv6 with bad accessibility from various places around the globe. Edit3: Since I've posted this humblebundle.com implemented registration & filtering in their tracker, so it won't work with 3rd party torrents. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: zvs on August 01, 2014, 10:15:43 AM Maybe it should be changed to "udp://open.demonii.com:1337" like all the newer torrents? This new tracker is accessible worldwide. udp://open.demonii.com:1337 is by far the best also udp://tracker.openbittorrent.com:80/announce udp://tracker.publicbt.com:80/announce http: //open.nyaatorrents.info:6544/announce , which i guess you can use for things other than anime udp://tracker.ex.ua:80/announce udp://coppersurfer.tk:6969/announce udp://9.rarbg.com:2710/announce udp://glotorrents.com:6969/announce and istole.it still works i guess Title: Re: [ANN] Bitcoin blockchain data torrent Post by: colinistheman on August 01, 2014, 11:13:00 AM From a security standpoint: Doesn't sharing the Bitcoin blockchain file like this cause the file to become at the mercy of the original uploader's intents? (and thus centralized?)
For example, if the uploader of this bittorrent blockchain file decides to share an altered/corrupted version of the file, and if everyone uses his version (assuming he has over 50% of people using his version of the file) then his blockchain version will be effectively adopted including all alterations to it? Just speculation here as to the potential drawbacks of this method. It seems to centralize the blockchain, due to the one individual starting the torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on August 01, 2014, 11:33:36 AM It is very easy to check, we have at least dozen of block explorers.
When u use some of this torrents, you just need check for block hash and it is all clear. Blockchain can not be corrupted/faked because of power that is need to solve single block. And all blocks after this "crafted" one have to be solved to. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on August 01, 2014, 02:53:47 PM Just speculation here as to the potential drawbacks of this method. Chances of corrupting bitcoin client by feeding it a corrupted bootstrap.dat are the same as feeding it corrupted data through the listening port: pretty low, mostly wasting time and bandwidth.The only nefarious thing I can think of is to seed it and listen for the fresh leechers. Statistically speaking there's much higher chance than the leecher of this torrent is a Bitcoin beginner and is possibly somewhat impatient. Therefore there are bigger chances that the leeching computer is still not properly configured/secured and attacking it may give a higher chance of finding a successful exploit. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: giveBTCpls on August 01, 2014, 02:58:40 PM How safe is to download the blockchain from a source that isn't directly Bitcoin QT? Im too paranoid in regards to this so I always end up downloading it directly from the software. Could Bitcoin.com have an at least weekly updated torrent?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on August 01, 2014, 03:45:42 PM How safe is to download the blockchain from a source that isn't directly Bitcoin QT? Im too paranoid in regards to this so I always end up downloading it directly from the software. Could Bitcoin.com have an at least weekly updated torrent? With this level of paranoia you'll really be better off by seeking help from the behavioral health professional. Or maybe a clergyman.The honest computer science professional will have no constructive advice to you. You'll become just a fodder for computer science quacks or scientologists. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rme on August 01, 2014, 06:44:55 PM From a security standpoint: Doesn't sharing the Bitcoin blockchain file like this cause the file to become at the mercy of the original uploader's intents? (and thus centralized?) For example, if the uploader of this bittorrent blockchain file decides to share an altered/corrupted version of the file, and if everyone uses his version (assuming he has over 50% of people using his version of the file) then his blockchain version will be effectively adopted including all alterations to it? Just speculation here as to the potential drawbacks of this method. It seems to centralize the blockchain, due to the one individual starting the torrent. If only one peer has a better blockchain your client downloads that one. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on August 03, 2014, 08:48:34 PM Beta-testing and pre-seeding a new torrent at http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent Please only join if you already have an old bootstrap.dat file, or you built the new one yourself using linearize.py (https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize) and bitcoind. And lose my seed ratio of 115!? I suggest some of us keep seeding the currently live version until the demand for it drops off. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: th3joker on August 07, 2014, 12:30:23 PM Wouldn't it be better to upload this to usenet?
At least people could download it at the full speed of their internet connection then. I would upload it if I could work out how to do it, also my upload speed is crappy compared to download. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on August 07, 2014, 04:32:05 PM This torrent usually is well enough seeded that normal internet lines should be easily saturated. I don't really see a reason to spam Usenet servers with data to accomplish this...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Mr_Banana_Split on August 07, 2014, 04:59:44 PM Anyone know a good website with visuals on blockchain growth? (and/or other alts would be cool too) thankxx! mbs Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rme on August 07, 2014, 06:46:17 PM Anyone know a good website with visuals on blockchain growth? (and/or other alts would be cool too) thankxx! mbs Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on August 10, 2014, 03:31:56 AM What about the classic torcache
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dexX7 on August 10, 2014, 04:32:49 PM TIL:
- This torrent is extremely useful, thanks Jeff and all the seeders! - DO droplets are much faster than I expected. https://i.imgur.com/2xtGOUN.png ;D Title: Re: [ANN] Bitcoin blockchain data torrent Post by: aahzmundus on August 15, 2014, 05:43:22 PM When is the new torrent going "Public"?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: zvs on August 18, 2014, 02:41:43 PM This torrent usually is well enough seeded that normal internet lines should be easily saturated. I don't really see a reason to spam Usenet servers with data to accomplish this... Bitcoin blockchain would be some miniscule amount of traffic to these Usenet servers. Astraweb and Giganews and what not get terrabytes of TV shows every hour during primetime, lol. Besides, you could just create a bitcoin binaries newsgroup for it. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Taxidermista on August 19, 2014, 08:57:29 AM Since I was curious about the new torrent, here's some info: new bootstrap.dat contains up to block height 313000 (July 8 ) WTF are you talking about? Last torrent was from april 2014. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: ddrown on August 19, 2014, 07:57:54 PM Since I was curious about the new torrent, here's some info: new bootstrap.dat contains up to block height 313000 (July 8 ) WTF are you talking about? Last torrent was from april 2014. See post on page 12: Beta-testing and pre-seeding a new torrent at http://gtf.org/garzik/bitcoin/bootstrap.dat.torrent Please only join if you already have an old bootstrap.dat file, or you built the new one yourself using linearize.py (https://github.com/bitcoin/bitcoin/tree/master/contrib/linearize) and bitcoind. ... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: zvs on August 21, 2014, 08:34:15 AM The linearize.py thing always craps out before it finishes for me. I have the blockchain up to 316481 just as a 7z file, and it's 16,023,242,033 bytes vs this bootstrap from April (?) that's 17,111,384,xxx...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on August 21, 2014, 10:28:44 AM See in linearize log, in my case it crashes on rpc timeout sometimes.
I has change timeout in code and run linearize as nice :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 23, 2014, 11:49:30 PM Torrent officially updated! See OP. New height: 317,000 @ 22.5 GB
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 24, 2014, 02:40:06 AM Note: For a minority of users, the bootstrap.dat "one huge 20GB file" import method does not work beyond 4GB of data. This is due to some limitations with large files on some 32-bit operating systems. It is planned to move away from a single bootstrap.dat file to a directory full of blkNNNNN.dat files that may be imported directly into bitcoind via "-reindex". The bootstrap.dat file also causes a 2x disk space increase over the "-reindex" method, which occasionally triggers complaints from users on low disk space cloud servers.
For these reasons, bootstrap.dat import method is being deprecated (at least with regards to this torrent). Today's torrent update will be the last bootstrap.dat torrent. Future torrents will include the block chain split into multiple files, never exceeding 1GB in size. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on August 24, 2014, 08:46:31 AM As far as I understood it, bootstrap.dat gets loaded automatically while with "-reindex" people need to know how to add something to a command line. I am not sure if this is not causing more issues for more people than the ones trying to run Bitcoin-Core on some ancient hardware.
Also Bitcoin-Core could prompt the user after importing from bootstrap.dat to delete the file, to combat the "double space taken" issue. I'd at least like to see both approaches continued until Bitcoin-Core finally is capable of downloading blocks from more than one source, then this whole thing can be discontinued anyways. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Adriano on August 24, 2014, 01:36:00 PM As far as I understood it, bootstrap.dat gets loaded automatically while with "-reindex" people need to know how to add something to a command line. I am not sure if this is not causing more issues for more people than the ones trying to run Bitcoin-Core on some ancient hardware. Also Bitcoin-Core could prompt the user after importing from bootstrap.dat to delete the file, to combat the "double space taken" issue. I'd at least like to see both approaches continued until Bitcoin-Core finally is capable of downloading blocks from more than one source, then this whole thing can be discontinued anyways. I agree keeping the process automagically performed is better for new users. How about include an empty file (flag file) in the torrent which only purpose is to indicate to the bitcoin daemon/wallet run the reindex process (the daemon/wallet would automatically remove this file after the reindex process is done) ? Adriano Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on August 25, 2014, 07:38:28 AM I agree keeping the process automagically performed is better for new users. Absolutely. Using a torrent at all is a hack and a (small) barrier to entry that should be removed if possible. But if using a torrent is the current plan I can throw bandwidth at it. There seem to be more downloaders than seeders on the new torrent right now. After changing torrents I'm downloading at 0kB/s and uploading at 1 MB/s. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Adriano on August 25, 2014, 11:52:26 AM I agree keeping the process automagically performed is better for new users. Absolutely. Using a torrent at all is a hack and a (small) barrier to entry that should be removed if possible. But if using a torrent is the current plan I can throw bandwidth at it. There seem to be more downloaders than seeders on the new torrent right now. After changing torrents I'm downloading at 0kB/s and uploading at 1 MB/s. If you already have the blockchain you should generate the file using the auxiliary script linearize.py instead of downloading it through the torrent (it is faster than downloading it and doesn't hurt the ones already seeding it, leaving bandwith for the ones who really need to download it). Despite of that, it is good to have more seeders indeed. Thanks, Adriano Title: Re: [ANN] Bitcoin blockchain data torrent Post by: ddrown on August 27, 2014, 12:44:19 AM Torrent officially updated! See OP. New height: 317,000 @ 22.5 GB No surprises comparing this file (sha256sum d05062052be4dd6fbaeac5f17598e52f7ad545f9f938acefaf7067ecce1d7b5a) with the blockchain. I hope posting these verifications is useful to others. I'm doing it this way because it's faster to stream data out of bootstrap.dat rather than pulling the data out of bitcoin-cli. So I can generate the sha256sum from the client once for a given range, and use it to verify that the data hasn't changed. Future updates just need a checksum out of bitcoin-cli covering the new parts. If anyone's interested in the blockheight program, I can publish it. Blocks 0 through 295000, bootstrap matches blockchain: Code: $ ./blockheight -e 295000 <bootstrap-317000.dat | sha256sum Blocks 295001 through 313000, bootstrap matches blockchain: Code: $ ./blockheight -s 295001 -e 313000 < bootstrap-317000.dat | sha256sum Blocks 313001 through 317000, bootstrap matches blockchain: Code: $ ./blockheight -s 313001 < bootstrap-317000.dat | sha256sum Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 27, 2014, 03:26:18 PM Thanks for double-checking my work!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: VEscudero on August 29, 2014, 02:13:56 PM Future torrents will include the block chain split into multiple files, never exceeding 1GB in size. I agree 100% with this choice, it does not make any sense to have a large file when smaller ones are easier to manage. This way, people that already has the first blocks can skip those ones and let their bittorrent client only download the last ones. Armory already downloads the blockchain through bittorrent by default, I wish the bitcore core client start doing it as well, until that moment you can count on me seeding this torrent manually for everyone at any time. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hops on August 30, 2014, 12:57:30 PM I'm having some trouble getting the 22.5 GB file. I have the 21GB which appears to be from last April. I tried using the torrent link from the OP as well as manually adding the infohash. They both lead me to the 21 GB file. Any thought as to what I'm doing wrong?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Wealthy on August 30, 2014, 01:46:32 PM I am confused, what is this data used for? Is this even useful? How can we benefit from it?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dserrano5 on August 30, 2014, 02:24:46 PM I am confused, what is this data used for? Is this even useful? How can we benefit from it? If you're setting up a new full node, it's faster to get the blockchain via torrent (and then let bitcoin core import and validate it) than to let bitcoin core download it by itself. This is because bitcoin core currently downloads from one peer at once, which isn't optimal. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hops on August 30, 2014, 07:47:18 PM i still think the new torrent link is incorrect.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: btcformat on August 30, 2014, 08:04:43 PM How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent?
I have a 7mb adsl. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on August 30, 2014, 08:54:19 PM i still think the new torrent link is incorrect. Can you be more specific? Which link is incorrect? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on August 31, 2014, 09:52:58 AM How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent? I have a 7mb adsl. Downloading bootstrap.dat will take some hours and syncing will take a few hours more. :) It might go upto 1-2 days. ~~MZ~~ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: future_quark369 on August 31, 2014, 04:32:35 PM I'm downloading. Thank you all. It looks like a lot of time saved using them for more than a pc.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on August 31, 2014, 08:10:02 PM How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent? I have a 7mb adsl. It took me 3 days with a 100MBit connection with bitcoin-core. As has been said: you sync only with one client, if you are lucky they have a fast connection. With the torrent you will use your line at ~90% (keep 10% for orga/surfing) or even fully*. It went up to When you are done keep seeding to help others. * Edit: just did a test. The torrent runs at ~ 24MBit/s after ~30 seconds. bitcoin-core is never going to achieve that rate. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on August 31, 2014, 08:42:53 PM I'm having some trouble getting the 22.5 GB file. I have the 21GB which appears to be from last April. I tried using the torrent link from the OP as well as manually adding the infohash. They both lead me to the 21 GB file. Any thought as to what I'm doing wrong? 22500000 bytes are approx. 21 GiB (1024 bytes = 1 GiB), so if your client displays "21 GB", it is already the new file. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: zvs on September 01, 2014, 03:32:45 AM How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent? I have a 7mb adsl. Downloading bootstrap.dat will take some hours and syncing will take a few hours more. :) It might go upto 1-2 days. ~~MZ~~ Anyway, I can fully reindex the blockchain in an hour or so on an i7-4770, w/ the blockchain all being stored in RAM. On a 7Mbps link, it'd probably be faster to download it from a fast node and sync it as it downloads, if you have anything faster than an i7-2600 or so. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: VEscudero on September 11, 2014, 12:41:20 PM Hello,
for those of you that have problems downloading from the torrent, I have created a par2 parity volume of the bootstrap.dat file that has 317000 blocks (22566124235 Bytes). Bittorrent makes a pretty good job of distributing rarest parts of the file first, but if someone has problems getting the full boostrap.dat file from bittorrent, she can try to reconstruct it from the parity archives I have created. I have created enough recovery blocks to help people reconstruct the full bootstrap.dat (of about 22 GB in size) even from the old bootstrap copy from April that cointained about 17GB. I encourage you to first download the index bootstrap.dat.par2 and verify how many blocks you need before trying to download the rest of the par2 blocks you need. Here you have almost 5GB of recovery blocks with a small block size of 2 MB (exactly the same as in the torrent), which is an extreme test case for any PAR2 implementation: https://mega.co.nz/#F!ixcyQRJB!toDzjgV9XTYAs1WBQ6lTnA (https://mega.co.nz/#F!ixcyQRJB!toDzjgV9XTYAs1WBQ6lTnA) You might want to download them though bittorrent as well: http://torcache.net/torrent/6D89F7B4327E2A1EBC7BD3DC269825DF92D660C3.torrent P.S: Please be advised than par2 recovery its quite time consuming and this should be only viewed as a last resort in case you cannot download the file through Bittorrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 15, 2014, 09:46:08 AM I'm totally new to bitcoin and I just have to get this off my chest now: dealing with that huge database was one of the most nightmarish computer experiences I ever had.
Why does nobody ever mention that it's not just the slow download that makes getting the database such a pest, but also the IMPORTING of the full database? I first downloaded 17,2 GB successfully through the software, then I got your torrent with the intention of speeding things up. Now I find out that IMPORTING the database is AT LEAST as slow as downloading it. My nice old torrent ratio is fucked up now. I will need a new external HDD, if I want to keep that intractable database (I'm one of those that couldn't move it around between partitions because of the size limit mentioned in this thread). And I STILL haven't got the database working. I feel like my computer and my HDDs, running at full speed, have aged by several years over the last days ...and so have I. Using bitcoin together with that database seems to be for geeks that have at least one spare computer at home and can use it for installing and importing this intractable database. I'll probably give up over the next days, if "importing" the final 2 GB from the database will never stop (it sure looks like it), and probably will stick to using online wallets. This is simply too much for me, my nerves and my computer. I wonder, why can't the database be torrented in its original form (the way it appears after it is imported), so it only needs to be verified within perhaps half an hour or so and not "imported" over several days? BTW, the download of the torrented database went real fast at full speed (16 MB here), and it's nice to see that there are so many generous contributors (seeders) in the community. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on September 15, 2014, 10:34:25 AM -snip- I wonder, why can't the database be torrented in its original form (the way it appears after it is imported), so it only needs to be verified within perhaps half an hour or so and not "imported" over several days? Because that would require trust. Would you trust strangers on the internet that the data on your copy of the blockchain is legit? Your clients needs to verifiy each block. If you think its such a hassle you can allways use thin/lite clients like electrum or multibit. They offer the security of a local wallet yet dont require you to download the complete blockchain. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 15, 2014, 03:14:13 PM I do have MultiBit already (to make it run, I had to install bulky Java again, after I had uninstalled it just a few weeks ago, duh). Electrum didn't run here at all. I sure would have liked to handle it the more professional and securer way, with the database. Maybe I'll go at it slowly, importing a few spare hours every day, though that will make importing the final two gigabytes last for a week probably.
Regarding the torrent, I always thought, if a torrent file had been tampered with, it would be rejected by trackers. But I trust, if it worked like that, the good people here would have used it that way already long time ago. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: giveBTCpls on September 15, 2014, 03:44:53 PM @Kelp! Yes, running Bitcoin QT is a pain in the ass, thats why they've come up with lightweight wallets. Look it up.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 15, 2014, 05:03:09 PM It would have helped, if in the very FIRST POST some of the problems to be encountered with the database would have been mentioned:
1. For instance, it isn't mentioned that you need a free space of over TWICE the size of the database on a partition to be able to "import" the torrented database. I was moving data around like crazy between partitions and external HDDs, just to be able to accomodate that huge database. And later I had to move around yet more data when I found out that I needed twice the size to "import" the database successfully. I also found out that I couldn't move the database to an external HDD at all because of that file size limit mentioned only later somewhere in this thread. 2. Also, the fact that the process of only IMPORTING from the torrented database (not just downloading through the client) will take quite a few days (with the computer using up almost all system resources and slowing down other processes) should be mentioned in the FIRST post, so people get an inkling of what's coming towards them. I've gone too far by now (with 19,6 GB successfully imported) to give up at this point. I'll probably carry through to the end, then see how the client behaves during future updates ...and then probably delete the database and stick to MultiBit. ;) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on September 15, 2014, 07:16:22 PM Why does nobody ever mention that it's not just the slow download that makes getting the database such a pest, but also the IMPORTING of the full database? Plenty of people mention this. The "headers-first" feature, hopefully in 0.10, fixes this issue. With headers-first, the client will import much faster than torrent + import. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on September 15, 2014, 09:50:16 PM I was moving data around like crazy between partitions and external HDDs, just to be able to accomodate that huge database. If a couple dozen GB are "huge", you might want to get a new HDD/SSD anyways. Ten times the size of the block chain in storage costs about as much as a BigMac menu at McDonald's... Who the hell uses several partitions on one disk these days anyways?Also reindexing takes a few hours at most on my machine, so probably you're running on something that might not really be fit to run a full node in the first place. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Skavenger on September 15, 2014, 10:20:45 PM i need to improve my connection, this is taking fucking forever :'(
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on September 15, 2014, 10:39:01 PM i need to improve my connection, this is taking fucking forever :'( Yeah, this torrent is a good one to debug your connection. I have one machine seeding it and I see various clients reporting download speed in the range from 10kB/s to 10MB/s (100kbps to 100Mbps).Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 16, 2014, 07:04:26 AM Quote The "headers-first" feature, hopefully in 0.10, fixes this issue. With headers-first, the client will import much faster than torrent + import. Sounds good. May it arrive soon. Quote Also reindexing takes a few hours at most on my machine, so probably you're running on something that might not really be fit to run a full node in the first place. Like I mentioned already, as it is right now, it seems to be more suitable for geeks (preferably with a second computer). It shouldn't be like that. It should be also for the average user. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on September 25, 2014, 09:55:26 PM Like I mentioned already, as it is right now, it seems to be more suitable for geeks (preferably with a second computer). It shouldn't be like that. It should be also for the average user. The thing is running full nodes really is for bitcoin geeks. We want as many people running them as possible but the fact is that it's just not the right solution for most casual bitcoin users who just want to use bitcoin rather than run the infrastructure behind it. The right solution for you is Electrum, Multibit, or some other light client. They still do the signing on your hardware with private keys only you have access to, so they really are as secure as a full node. I don't know why Electrum doesn't work for you, I thought it was quite reliable on windows. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 26, 2014, 02:40:39 PM Electrum doesn't run here because I have only XP with SP1 installed (and I won't update for various reasons). Some software requires at least SP2 to run. Of course, MultiBit requires Java to be installed. So, I'm sticking to MultiBit with Java now.
I've given up now using Bitcoin Core with its 21 GB (and growing) database because simply starting it with an up-to-date database, it would take about 20 minutes on my computer to "verify" before the program could be used ...and then it would still take quite some time until the newest blocks were downloaded. That's a no-go for me. Considering that I'll perhaps make one bitcoin transaction every few months and I'd then have to wait for hours to download the newest blocks, MultiBit is the right solution for me. I'll keep seeding the torrented blockchain for a while and use it to test my new VPN connection (I only started using bitcoin to pay for the VPN service in the first place). I'll also be on the look-out for future improved versions of Bitcoin Core (as hinted at by jgarzik) and test them once in a while. It IS a fascinating project. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on September 26, 2014, 03:50:34 PM -snip-I have only XP with SP1 installed (and I won't update for various reasons). -snip- This is off topic, but whatever your reason are. UPDATE NOW! Running WinXP with SP1 on a machine thats online is like begging for trojans. Your system is most likely infected allready as every scriptkiddie that knows how to install a linux distro can easily "own" your system with metasploit. If you must have WinXP for specific tools that you can not get to run on a modern OS, use VM Ware. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: deadweasel on September 26, 2014, 03:52:44 PM -snip-I have only XP with SP1 installed (and I won't update for various reasons). -snip- This is off topic, but whatever your reason are. UPDATE NOW! Running WinXP with SP1 on a machine thats online is like begging for trojans. Your system is most likely infected allready as every scriptkiddie that knows how to install a linux distro can easily "own" your system with metasploit. If you must have WinXP for specific tools that you can not get to run on a modern OS, use VM Ware. My god that is a horrifying setup. Please, be responsible with your BTC Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 26, 2014, 04:26:28 PM ...and I'm not using any anti-virus either! LOL Sorry, my system is failsafe whatever any "geek" or "IT-expert" may say to the contrary. And I'm not going to discuss it either. Period! ;)
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on September 26, 2014, 04:35:18 PM This is off topic, but whatever your reason are. UPDATE NOW! Running WinXP with SP1 on a machine thats online is like begging for trojans. Your system is most likely infected allready as every scriptkiddie that knows how to install a linux distro can easily "own" your system with metasploit. If you must have WinXP for specific tools that you can not get to run on a modern OS, use VM Ware. As a person who also runs Win XP SP1 (for reasons unrelated to Bitcoin), I'm curious. Is there a real way to exploit such a machine (by a scriptkiddie or a real hacker) when the only Internet-visible port is tcp/8333 and the respective outgoing connections? Or is shorena spouting a standard pseudo-security paranoia? Please don't talk about social engineering attacks or other attacks involving physical access to the hardware.Edit: Like Kelp! I also don't run antivirus on it, although I monitor it with a Tripwire-equivalent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on September 26, 2014, 06:53:43 PM -snip- As a person who also runs Win XP SP1 (for reasons unrelated to Bitcoin), I'm curious. Is there a real way to exploit such a machine (by a scriptkiddie or a real hacker) when the only Internet-visible port is tcp/8333 and the respective outgoing connections? Or is shorena spouting a standard pseudo-security paranoia? Please don't talk about social engineering attacks or other attacks involving physical access to the hardware. Edit: Like Kelp! I also don't run antivirus on it, although I monitor it with a Tripwire-equivalent. I dont see what an antivirus software would do to prevent an attack anyway, some sort of IDS certainly would. I was under the impression that Kelp! is using the system to access the internet*, as in browse. If you are -as you describe it- only running a full node behind a proper firewall and never use a browser you should be fine. The list for WinXP is long and its the "go to"-system for examples in the metasploit books [1] because its so easy to gain access to. Most exploits however need either an open port or the victim to request it (usually via browser). Again, I did not intend to derail this thread with offtopic replies and if you are aware of the risks, go ahead. Its just that most people I encounted that still use WinXP do not use it deliberately but out of lazyness. And yes I am a bit paranoid. * using multibit, trying to get Electrum to work, downloading torrent files, etc. [1] refering to ISBN 978-3-89864-772-4 from 2012, but I assume others have similar content. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: HeadsOrTails on September 28, 2014, 10:15:54 AM How much time I need to sync the blockchain from zero using bitcoin-qt and how much with torrent? I have a 7mb adsl. It took me 3 days with a 100MBit connection with bitcoin-core. As has been said: you sync only with one client, if you are lucky they have a fast connection. With the torrent you will use your line at ~90% (keep 10% for orga/surfing) or even fully*. It went up to When you are done keep seeding to help others. * Edit: just did a test. The torrent runs at ~ 24MBit/s after ~30 seconds. bitcoin-core is never going to achieve that rate. I'm in Australia on ADSL2+ (24Mbps max is quoted by companies so I'd think ~10Mbps is true speed as max torrent DL speed I get is ~1150kbps ~= 10/8). I am getting 450kBps rate presently, which I'd have to think is ~50x faster than Bitcoin Core. There must be a better way than having 1 peer sending the blockchain; the upload bandwidth jammed to a halt for 4-5 days is infeasible at the painful induction crapshoot. Best way to resolve the issue? If you've either 1) DLd the torrent once before or 2) waited while BTC Core did its thing for 4-5 days, or 3) like Bitcoin ... seed the torrent! ;D Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 30, 2014, 09:16:02 AM I'd like to post a suggestion for those who are about to download the torrent blockchain and who care about their existing fine torrent ratio in their old torrent client:
With such a huge download (21GB right now), any sweet torrent ratio will inevitably get borked quickly (depending on how many GB you had uploaded previously). To save your old nice torrent ratio, consider getting a new torrent client (preferably a "portable" one) and use it only for downloading the blockchain. When you decide to seed it (either part of it, or 100% or more of it), you can load it in your old torrent client, and even improve your old ratio quite substantially by seeding that huge database. I wish I had done it like that, before I fucked up my cute old torrent ratio with this blockchain torrent. ;-) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on September 30, 2014, 09:25:33 AM Who cares about some arbitrary "ratios" displayed locally in a client?! What matters is how much you actually do upload...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on September 30, 2014, 10:30:18 AM Who cares about some arbitrary "ratios" displayed locally in a client?! What matters is how much you actually do upload... Indeed, so in order to avoid a "bad ratio" just share the blockchain data torrent until you uploaded at least as much as you downloaded. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 30, 2014, 04:47:00 PM Quote Who cares about some arbitrary "ratios" displayed locally in a client? Of course I posted my tip for those that care about their ratio, not for those that don't care. ;-)Quote Indeed, so in order to avoid a "bad ratio" just share the blockchain data torrent until you uploaded at least as much as you downloaded. Not necessarily. If you had a ratio of e.g. 2.0, you'd have to upload the file twice to get your old ratio back. For people with an average DSL connection, with typically fast download speeds but low upload speeds, that's almost impossible to achieve, especially when they prefer to go about other torrents. So, using a different torrent client exclusively for the blockchain torrent, is a simple way to keep your old ratio.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on September 30, 2014, 05:01:25 PM Quote Who cares about some arbitrary "ratios" displayed locally in a client? Of course I posted my tip for those that care about their ratio, not for those that don't care. ;-)Quote Indeed, so in order to avoid a "bad ratio" just share the blockchain data torrent until you uploaded at least as much as you downloaded. Not necessarily. If you had a ratio of e.g. 2.0, you'd have to upload the file twice to get your old ratio back. For people with an average DSL connection, with typically fast download speeds but low upload speeds, that's almost impossible to achieve, especially when they prefer to go about other torrents. So, using a different torrent client exclusively for the blockchain torrent, is a simple way to keep your old ratio.Esp. if you use torrents on a regular basis you should just keep this one running for a few months. Everyone seeding is increasing its speed for those downloading it. If you care enough about other torrents to get a 2:1 ratio, why not about this one? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Kelp! on September 30, 2014, 05:34:40 PM Quote If you care enough about other torrents to get a 2:1 ratio, why not about this one? Like I said, with some DSL connections it's technically almost impossible to achieve (except you let your computer run 24/7 for some time). I'll try to reseed about half of the blockchain, I don't think I have the time and patience to reseed it entirely. I also need to delete the blockchain torrent eventually, to have more free space on my HDD for other torrents again. Such an ENORMOUS single file does bring about some problems on some set ups. ;-)Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Meuh6879 on October 01, 2014, 11:27:54 AM downloaded successfully : https://bitcointalk.org/index.php?topic=252937.msg9034028#msg9034028
For now, integration is running : https://bitcointalk.org/index.php?topic=252937.msg9040466#msg9040466 WinXP SP3 + all KBs installed. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Meuh6879 on October 01, 2014, 03:02:22 PM 1 crash after read 2To and writing 18Go (task manager open on this bitcoin-qt.exe process).
Need to restart bitcoin core ... it must scan the 18Go and keep working of the integration of the bootstrap.dat (for me, 30 weeks to process after this crash). Title: Re: [ANN] Bitcoin blockchain data torrent Post by: mistercoin on October 01, 2014, 06:03:27 PM Very nice! I will add it to my seedbox ;D
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Meuh6879 on October 01, 2014, 06:51:51 PM :D thanks for this.
I think that the torrent bootstrap.dat is the only way to download the blockchain now ... because bitcoin network is massively stopped by orphan block. :( Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Yoghurt114 on October 03, 2014, 12:03:52 PM I was updating from the 16gig bootstrap to the current (21gig) torrent and noticed they don't go side by side initially (ie. the 21 gig one doesn't start off from where the 16gig one stopped). I deleted both torrents (not the actual bootstrap file) and loaded the 21 gig torrent by itself, it (uTorrent that is) started checking the file as I would expect, but then started downloading from 0%. I expected it would start downloading right around 70% or so. Is this expectation wrong? Or did I do it wrong?
TLDR; How do I update the torrent to a more recent version without downloading from scratch? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: tl121 on October 03, 2014, 01:10:29 PM I am running bitcoin-0.9.2-linux on Debian. I got a copy of linearize from github and ran it using Python 2.7.3. I had no problem creating hashlist.txt, but when I ran linearize-data.py I got errors. There were other skipped blocks, but the end was as follows:
Quote Wrote 239000 blocks Skipping unknown block 000000000000007dae319c0420d12bf47f14ed63a994d2402b9bb9a69d0b732d Input file/home/tony/.bitcoin/blocks/blk00024.dat Out of order block. Expected 000000000000008a098f009454d431be775eb87a3c4ffbfe04a8eaf127de0aa6 Got 000000000019d6689c085ae165831e934ff763ae46a2a6c172b3f1b60a8ce26f I figured that my block data was somehow corrupted, so I ran bitcoin-qt with checkblocks=0 and checklevel=3. Then I re-ran linearize with the same result. Then I ran bitcoin-qt --reindex and spent a day doing a complete reindex. I then reran linearize and got the same error. This concerns me, because if my blocks on disk had somehow gotten corrupted then bitcoin-qt should have found the corruption. Does anyone have an idea what may be wrong? Follow-up edit. I cleared out all of the files in .bitcoin and downloaded the block chain from another node on my network. This took about 18 hours. Then I ran linearize and produced a good bootstrap.dat file and it is presently seeding. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on October 08, 2014, 10:00:32 PM Who cares about some arbitrary "ratios" displayed locally in a client?! What matters is how much you actually do upload... The only thing that really matters is that anyone who wants the data should be able to get hold of it as fast as possible. The more bandwidth we have seeding the better but if anyone really can't seed they should not feel bad about it. It's not an obligation. Title: Excessive seed ratio? Post by: sd on October 26, 2014, 07:48:46 PM I've been seeding the new torrent for 2 months now on a well connected server and have a seed ratio of 548. That's about 12 TB uploaded by one server in 2 months. I'm wondering if this is all due to people setting up full nodes, or if something else is happening here. If you are a long term seeder are you getting similar results? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on October 27, 2014, 10:08:07 AM I've been seeding the new torrent for 2 months now on a well connected server and have a seed ratio of 548. That's about 12 TB uploaded by one server in 2 months. I'm wondering if this is all due to people setting up full nodes, or if something else is happening here. If you are a long term seeder are you getting similar results? Armory likes to use it Title: Re: [ANN] Bitcoin blockchain data torrent Post by: LeMiner on October 27, 2014, 12:25:01 PM I've been seeding the new torrent for 2 months now on a well connected server and have a seed ratio of 548. That's about 12 TB uploaded by one server in 2 months. I'm wondering if this is all due to people setting up full nodes, or if something else is happening here. If you are a long term seeder are you getting similar results? Armory likes to use it This exactly, armory loves using this torrent. I've been seeding it for quite a while now. I tried out the download speed yesterday from this torrent and got around 25MB/s (around the max of the connection I'm using at home). I'm sure it would be even faster on my business connection. Either way, keep seeding and everybody thanks for providing this service. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: defcon23 on November 10, 2014, 10:03:20 AM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? it will be much appreciated by many users ,( me included ) , since it became almost impossible to syncronise bitcoin core in a decent downloading time...even with a really good conection.
Actualy it is a serious problem for this software.. :-\ Bitcoin core developpers should have to seriously work on this.. Thanx in advance 8) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on November 10, 2014, 07:26:45 PM header first syncing is already merged, so this is already fixed in the next version. There is likely not going to be a new bootstrap.dat until then...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Meuh6879 on November 10, 2014, 07:30:32 PM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? it will be much appreciated by many users ,( me included ) , since it became almost impossible to syncronise bitcoin core in a decent downloading time...even with a really good conection. Actualy it is a serious problem for this software.. :-\ Bitcoin core developpers should have to seriously work on this.. +1 from the last time that i have rebuilded the blockchain (october 2014). bitcoin core is heavy duty corrupted by orphan block (for the new arrival members) ... and very high restriction from the client to upload blocks to others. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on November 11, 2014, 03:52:09 PM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? Read the OP and download the torrent. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: defcon23 on November 11, 2014, 07:49:36 PM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? Read the OP and download the torrent. thanx for your answer. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on November 13, 2014, 11:52:15 AM My seed ratio is up to 681 now. If anyone wants to setup seeders the cheapest way I found was on a AMD Athlon 64 5600+ X2 at https://robot.your-server.de/order/market . EUR 25 a month for a dedicated machine with serious bandwidth. Setting up transmission-cli under screen isn't difficult. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: PabloW on November 25, 2014, 03:52:48 AM Thanks! downloading. Where is exactly the folder where I should place this file?
Also, Armory says i'm in 254069 block, where can I see whats the total number of blocks at this moment? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on November 25, 2014, 11:30:09 AM Thanks! downloading. Where is exactly the folder where I should place this file? Copy the bootstrap.dat file and paste it in, %APPDATA%\Bitcoin (Windows), ~/.bitcoin/ (Linux) or ~/Library/Application Support/Bitcoin/ (Mac) . Also, Armory says i'm in 254069 block, where can I see whats the total number of blocks at this moment? You can see it on http://www.bitcoinwatch.com/ ( have other details) or https://blockchain.info/charts (recommended) or http://blockexplorer.com/q/getblockcount (shows the block count only). :) ~~MZ~~ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 28, 2014, 01:44:23 PM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? Read the OP and download the torrent. I came as far as block 317000. That's more that 13 weeks old tells bitcoin-qt.. Then I got stuck. I have 12 active connections to the network. Is there a regularly, like every 24 hours, maintained version of bootstrap.dat out there? So.. I am pretty sure I can take this upon me. Automate it and let it rip. The only problem I see is the huge bandwidth capacity needed. Answers or suggestions? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on November 28, 2014, 02:07:46 PM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? Read the OP and download the torrent. I came as far as block 317000. That's more that 13 weeks old tells bitcoin-qt.. Then I got stuck. I have 12 active connections to the network. Is there a regularly, like every 24 hours, maintained version of bootstrap.dat out there? So.. I am pretty sure I can take this upon me. Automate it and let it rip. The only problem I see is the huge bandwidth capacity needed. Answers or suggestions? Please take the time to read OP. :) =snip= How often will this torrent be updated? Assuming this project is deemed useful and worth continuing... the torrent will be updated once every few months, when the checkpoints are updated in the reference client source code (https://github.com/bitcoin/bitcoin/). Why not update the torrent more often? A torrent works best when it is a large, static dataset that changes infrequently. That maximizes the ability to seed the data, enabling even part-timer seeders to contribute meaningfully. Less frequent changes also minimizes the risk that a malicious torrent will appear, with a long, malicious side chain. The current policy only updates the torrent after blocks are buried many thousands deep in the chain. ~~MZ~~ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on November 28, 2014, 04:29:06 PM -snip- Answers or suggestions? Launch with -connect=IP to a fast node for the rest. For windows hit Win+R to open the "run" window: enter: c:\Program Files\Bitcoin\bitcoin-qt.exe -connect=IP change the IP to one from the list, the path as needed and click ok. For linux, open a terminal and enter bitcoind -connect=IP change the IP and on some distros you have to give the full path to bitcoind. Note, this will not launch a GUI, use bitcoind getinfo so see the status. or run bitcoin-qt instead of bitcoind for GUI. Once synced, close bitcoin core and launch as usual. List of possible nodes: Code: last updated 2014.11.25 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 28, 2014, 04:59:15 PM -snip- Answers or suggestions? Launch with -connect=IP to a fast node for the rest. For windows hit Win+R to open the "run" window: enter: c:\Program Files\Bitcoin\bitcoin-qt.exe -connect=IP change the IP to one from the list, the path as needed and click ok. For linux, open a terminal and enter bitcoind -connect=IP change the IP and on some distros you have to give the full path to bitcoind. Note, this will not launch a GUI, use bitcoind getinfo so see the status. or run bitcoin-qt instead of bitcoind for GUI. Once synced, close bitcoin core and launch as usual. List of possible nodes: Code: last updated 2014.11.25 Ah.. I didn't know that. Thanks! I used bitcoind and then tail'd the log file.. But this -connect=IP is very helpful. Much reading to do still :) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 12:57:53 AM -snip- Answers or suggestions? Launch with -connect=IP to a fast node for the rest. -cut- Well, that was a nice experience.. The database corrupted every single try and I couldn't find what did it.. So I compiled bitcoind from source and imported bootstrap.dat Then finally I went on to connect again to the IP's mentioned before, only to discover that.. I was blocked :D Thanks guys.. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 01:04:45 AM Hi, is anyone got a FRESH & CLEAN bootstrap.dat file around ? Read the OP and download the torrent. I came as far as block 317000. That's more that 13 weeks old tells bitcoin-qt.. Then I got stuck. I have 12 active connections to the network. Is there a regularly, like every 24 hours, maintained version of bootstrap.dat out there? So.. I am pretty sure I can take this upon me. Automate it and let it rip. The only problem I see is the huge bandwidth capacity needed. Answers or suggestions? Please take the time to read OP. :) =snip= -cut- Why not update the torrent more often? A torrent works best when it is a large, static dataset that changes infrequently. That maximizes the ability to seed the data, enabling even part-timer seeders to contribute meaningfully. Less frequent changes also minimizes the risk that a malicious torrent will appear, with a long, malicious side chain. The current policy only updates the torrent after blocks are buried many thousands deep in the chain. ~~MZ~~ Yes, now I read the whole OP this makes sense. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 12:57:11 PM -snip- Answers or suggestions? Launch with -connect=IP to a fast node for the rest. -cut- Well, that was a nice experience.. The database corrupted every single try and I couldn't find what did it.. So I compiled bitcoind from source and imported bootstrap.dat Then finally I went on to connect again to the IP's mentioned before, only to discover that.. I was blocked :D Thanks guys.. The sole reason I appeared here was that I forgot.. one time only.. to backup the block chain database before re-installing a new OS on my computer. I got the grandfather instead of the father in the backup protocol. So.. Torrent'ing a bootstrap database, waiting for clues from the local super-heroes.. Because hey.. I just want to pay my insurance on Monday.. Then.. The realization that many 'contributors' just say "f*ck you, man.." in a newbie's face when he seems to be down and struggling.. I've seen this behavior before, and at the time I was disgusted by the apparent change. No one seemed to bother to read Virginia Shea anymore and just went on to become rampant egomaniacs. Yeah, I know.. This is frustration with the proceedings of a once promising protocol. But right now it seems you are in the tub with that frog. A question that reeds to be answered by each and every local bitcoin super-hero: Do you want a worldwide payment protocol, or just goof around for personal glory for some time. Of course there is some momentum still; you've got your new arrivals, and hey.. conferences where you can pat each other on shoulders how ultra-famous that guy is. That actually is my clue that you fail to see the significance of what you are holding in your hands right this minute. Later there will be the names, the guys with beards somewhere out there, telling how they had it in their own hands but lost it; fumbled, dropped the ball, and lost the game. So I smile, knowing that some of you will see, and many others will remain as blind as they are.. Now I really have that insurance to pay. And you're not helping, Eternal September people.. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 02:33:05 PM Packing up..
I've compiled bitcoind and bitcoin-qt from source on Ubuntu 14.04. I mostly do that, but I was lazy this time so I got the canned version. I should've known better. Then I downloaded bootstrap.dat via Torrent and cleaned my system as to avoid any circumstance that could make things go FUBAR, and ran bitcoind. Nice, it worked: bitcoind was loading blocks from bootstrap.dat, and it seemed to work like a charm. No more corruption of the database like with the canned bitcoind. Good. When bitcoind finished loading from bootstrap.dat on block 31700, I stopped bitcoind. Then I ran bitcoin-qt . To read..: "No block source available. 1 year and 32 weeks behind." "19 active connections to the Bitcoin network," and "Catching up... Processed 232045 blocks of transaction history. ... " I know that my node seemed to be misbehaving because I had to reload the same blocks after every time the canned bitcoind seemed to corrupt the blockchain database. I have never ever experienced this with a self-compiled version of either bitcoind, or bitcoin-qt. Last night I pulled my blocks from famous 173.236.158.177, the blockchain database crashed a few times, and so I'm given no quarters anymore. Can you see a newbie struggling with this? He or she doesn't want to be a programmer or systems expert, he or she just want to adopt this cool new fad.. Yeah, it shot up to $1,000 - hello.. geek millionaires - from nothing, and then crashed to like $275 - hello.. people who lost an arm and a leg - something, but hey people seem to think it's viable. Well, this single experience tells me that it is not. This is not a serious global payment system, decentralized or not. This is hobby stuff. And while fiat value - hey.. they CPU mined bitcoin - for some is still good, this is going nowhere really fast. I don't mean that bitcoin will disappear, because let's face it there is a lot of real money put in.. But like this? Like this one experience I am having now, after all these years? Just going it from the seat of my pants one time? Dudes, you are delusional.. Ok.. I will say it. This actually IRL screwed me over. Ok? There, now you can gloat. Another one bites the dust never to come back again. Happy now? Good. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on November 29, 2014, 02:40:18 PM Can you see a newbie struggling with this? He just posted a few times in this thread... ;-)You don't need to run a full node or even the reference implementation if you want to use Bitcoin, alternatively you can just wait for 0.10 to come out where bootstrapping should work much faster. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 02:51:25 PM Can you see a newbie struggling with this? He just posted a few times in this thread... ;-)You don't need to run a full node or even the reference implementation if you want to use Bitcoin, alternatively you can just wait for 0.10 to come out where bootstrapping should work much faster. Yeah.. Well it had to. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 03:07:27 PM Can you see a newbie struggling with this? He just posted a few times in this thread... ;-)You don't need to run a full node or even the reference implementation if you want to use Bitcoin, alternatively you can just wait for 0.10 to come out where bootstrapping should work much faster. 1200 some posts makes you local super-hero hm? This my man is a sucker punch, a kick in the head to someone who is down. A glaring gloat.. I know what I can do, and I also know what can't be done in my situation now. Yeah, I have not been following devs for years, and yeah, I just took the new source, read the change log, and went on with business. While you were real busy creating your local super-hero status. You know nothing about who I am or how early I adopted Bitcoin. You know nothing about my systems knowledge. Nor about my knowledge of Bitcoin platforms and portability. You don't know if I had a time-window closing. The only thing you know is that I use bitcoind on Ubuntu 14.04 now. And I needed (!) to do it this way. You have not been of any help super-hero. You just did some lip-gymnastics here. But it's done now. I just made the mistake of trust. Once. Bye. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on November 29, 2014, 03:14:54 PM Activity != posts. I would love to hide these stats next to my posts by the way.
I judged you based on what and how you posted here. Also your forum title as of writing this actually IS "Newbie". Enjoy your amazing ubuntu machine, Linux skills and fantastical amount of BTC that you mined far earlier than me. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 03:32:43 PM Activity != posts. I would love to hide these stats next to my posts by the way. I judged you based on what and how you posted here. Also your forum title as of writing this actually IS "Newbie". Enjoy your amazing ubuntu machine, Linux skills and fantastical amount of BTC that you mined far earlier than me. Hm.. This is the real newbie answer. Biased because of entrance time, and board status.. I mine Bitcoins yes, for years now. Yes, I CPU mined them also. No, I did not buy a pizza back then. But whatever amount, there was very little converted to fiat. So I ain't no fat cat like some, right? And yeah, some of my systems run Linux, some don't. How I stepped in? Well, I didn't expect a closed community like some of the newsgroups, and I certainly did not expect a post score based status thing. Some seem to need that. Like with reference codes in their .sig.. I didn't see that either. So I simply asked stuff I didn't know, right? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 03:42:01 PM Activity != posts. I would love to hide these stats next to my posts by the way. I judged you based on what and how you posted here. Also your forum title as of writing this actually IS "Newbie". Enjoy your amazing ubuntu machine, Linux skills and fantastical amount of BTC that you mined far earlier than me. Hm.. This is the real newbie answer. Biased because of entrance time, and board status.. I mine Bitcoins yes, for years now. Yes, I CPU mined them also. No, I did not buy a pizza back then. But whatever amount, there was very little converted to fiat. So I ain't no fat cat like some, right? And yeah, some of my systems run Linux, some don't. How I stepped in? Well, I didn't expect a closed community like some of the newsgroups, and I certainly did not expect a post score based status thing. Some seem to need that. Like with reference codes in their .sig.. I didn't see that either. So I simply asked stuff I didn't know, right? I don't even know whether there is a propagation system for bad nodes. Should be if not :) Even though it leaves me dead now. Ah, f*ck this. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on November 29, 2014, 03:54:43 PM Please! keep the dramaqueen out. I am not even sure I understand your problem - the technical one, I dont give a fuck about how long you mined, your "status" or what you need your coins for - and frankly, I dont care to read through the wall of drama to figure out. The last few posts derailed this thread and if you need further help with bitcoin core I suggest you start a thread in the tech support section and keep it technical.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xhrike on November 29, 2014, 04:26:42 PM Please! keep the dramaqueen out. I am not even sure I understand your problem - the technical one, I dont give a fuck about how long you mined, your "status" or what you need your coins for - and frankly, I dont care to read through the wall of drama to figure out. The last few posts derailed this thread and if you need further help with bitcoin core I suggest you start a thread in the tech support section and keep it technical. You are right. I just cracked up because I saw stuff getting lost. Sorry 'bout the drama. Problem is: after downloading and importing bootstrap.dat and then conncting to the fast nodes, my database crashed a few times because I failed to see the problem was the canned version of bitcoind I used. After I compiled bitcoind and bitcoin-qt from source myself the problem seemed to be over. But now I am stuck again because the fast nodes seemed to have locked out my IP for pulling too much data, or because of a "misbehaving" node status because I pulled the same blocks a few times. I don't know. The only thing I do know is that I am stuck again on a frustratingly slow bitcoin network. Then of course I thought that perhaps "misbehaving" node IP's were propagated over the network leaving my IP address essentially stranded for ever. Like I said, I don't know. But blocks are not loading. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: tl121 on November 30, 2014, 05:28:37 PM Please! keep the dramaqueen out. I am not even sure I understand your problem - the technical one, I dont give a fuck about how long you mined, your "status" or what you need your coins for - and frankly, I dont care to read through the wall of drama to figure out. The last few posts derailed this thread and if you need further help with bitcoin core I suggest you start a thread in the tech support section and keep it technical. You are right. I just cracked up because I saw stuff getting lost. Sorry 'bout the drama. Problem is: after downloading and importing bootstrap.dat and then conncting to the fast nodes, my database crashed a few times because I failed to see the problem was the canned version of bitcoind I used. After I compiled bitcoind and bitcoin-qt from source myself the problem seemed to be over. But now I am stuck again because the fast nodes seemed to have locked out my IP for pulling too much data, or because of a "misbehaving" node status because I pulled the same blocks a few times. I don't know. The only thing I do know is that I am stuck again on a frustratingly slow bitcoin network. Then of course I thought that perhaps "misbehaving" node IP's were propagated over the network leaving my IP address essentially stranded for ever. Like I said, I don't know. But blocks are not loading. Perhaps you shouldn't be running a bitcoin node or any kind of large database software on your computer. I suggest you switch to a light weight client such as Electrum. There are ways to get your bitcoins into a new wallet based on a light weight client that won't require synchronizing the block chain. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Rotzer on December 23, 2014, 01:05:01 PM Thank you for maintaining this project.
Using your torrent saved me a lot of time. I apreciate your work very much. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xxxgoodgirls on January 02, 2015, 06:38:09 PM Hello, I just placed bootstrap.dat on the bitcoin core folder, but bitcoincore does not import the blocks, what am I doing wrong?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on January 03, 2015, 10:26:20 AM Hello, I just placed bootstrap.dat on the bitcoin core folder, but bitcoincore does not import the blocks, what am I doing wrong? Is in the same folder as your wallet.dat? Did you #1 close bitcoin core, #2 copy the file, #3 start bitcoin core? What OS? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: xxxgoodgirls on January 03, 2015, 01:59:45 PM Hello, I just placed bootstrap.dat on the bitcoin core folder, but bitcoincore does not import the blocks, what am I doing wrong? Is in the same folder as your wallet.dat? Did you #1 close bitcoin core, #2 copy the file, #3 start bitcoin core? What OS? yup I did everything like you said, maybe due to a corrupted bootstrap.dat? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 03, 2015, 02:09:17 PM At least on Windows closing the application might only minimize it to the tray...
I'd recommend just waiting a few days until 0.10. is released instead of trying to make the import from the torrent working - header-first syncing is so much faster and easier than using this torrent anyways. If it is really urgent, you can already try out the release candidate, it doesn't seem to be very buggy. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: c4p0ne on January 12, 2015, 10:58:13 AM Upgraded to 0.10. Now receiving "No block source available". :-\
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on January 12, 2015, 01:15:00 PM Upgraded to 0.10. Now receiving "No block source available". :-\ Try adding a node manually with: Code: addnode 213.165.91.169 add this should help you find other nodes. Full disclosure, this is my node and its not yet updated to 0.10.0rc1 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: franckuestein on January 16, 2015, 08:18:34 PM Thanks for sharing this Bitcoin blockchain data torrent with the community. Very useful in case someone is using the Bitcoin Core for the first time thanks to this feature:
If the file "bootstrap.dat" is found in the bitcoin data directory, it will validate and import all blockchain data found in that file. The following torrent presents a bootstrap.dat file for that feature. Seeding, too. :P Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BitCoinCool on January 19, 2015, 04:33:14 PM Thankyou for assisting many of us and making this avail.
After more than 6 days of downloading Core,I got frustrated and followed the advice Bootstrap the Blockchain Synchronization id found at GitHUb, which eventually lead me here. https://github.com/bitcoin/bitcoin/blob/master/doc/bootstrap.md (https://github.com/bitcoin/bitcoin/blob/master/doc/bootstrap.md) The Torrent in qBittorrent is not one iota faster than the original core download of the blockchain? The Torents been running for 2 days, and ETA is now 3days 10 hours showing 88% done. it must be a self defeating process to keep beating myself up like this! LOL!! At 88% almost 89 complete I'd hate to trash it all. any way to get through this without it taking a month os nights running? i was so excited after reading the github instructions, as I thought it might be all completed in less than an hour. any help is much appreciated. You're a gem to the community, obviously patient and helpful as noobs I for one appreciate ppl like you and hope to pif when / if eventually set up. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Madness on January 19, 2015, 04:51:22 PM Thankyou for assisting many of us and making this avail. After more than 6 days of downloading Core,I got frustrated and followed the advice Bootstrap the Blockchain Synchronization id found at GitHUb, which eventually lead me here. https://github.com/bitcoin/bitcoin/blob/master/doc/bootstrap.md (https://github.com/bitcoin/bitcoin/blob/master/doc/bootstrap.md) The Torrent in qBittorrent is not one iota faster than the original core download of the blockchain? The Torents been running for 2 days, and ETA is now 3days 10 hours showing 88% done. it must be a self defeating process to keep beating myself up like this! LOL!! At 88% almost 89 complete I'd hate to trash it all. any way to get through this without it taking a month os nights running? i was so excited after reading the github instructions, as I thought it might be all completed in less than an hour. any help is much appreciated. You're a gem to the community, obviously patient and helpful as noobs I for one appreciate ppl like you and hope to pif when / if eventually set up. The torrent of blockchain file is available on Bitcoin.org under the download links of Bitcoin Core and here is => https://bitcoin.org/bin/blockchain/bootstrap.dat.torrent , I downloaded it and it finished in 1 day 8 hours with a speed of ~200k/s (my max speed) One it's finished put it in Bitcoin folder on the AppData and launch your Bitcoin Core wallet and you are ready to go Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BitCoinCool on January 19, 2015, 05:37:51 PM Thankyou Madness, et.al.
I double checked the torrent in my app (qBittorrent) its the sourceforge source. Is it possible for me to add an additional torrent ontop or /instead without losing the 89% already done? Possible to combine the 2 sources? I believe I chose the one of 2 recommended in original article/post as it's the one I most easily verified cert/sig for.(been a couple of days) Ive got the qBittorrent settings also max'd out for my connection at 300kiB/s although certainly not running anywhere near that rate. I see the Peers only range from 1-9 ETA at about 21 hours currently. WOW! Thankyou for you assistance! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Madness on January 19, 2015, 05:40:11 PM Thankyou Madness, et.al. I double checked the torrent in my app (qBittorrent) its the sourceforge source. Is it possible for me to add an additional torrent ontop or /instead without losing the 89% already done? Possible to combine the 2 sources? I believe I chose the one of 2 recommended in original article/post as it's the one I most easily verified cert/sig for.(been a couple of days) Ive got the qBittorrent settings also max'd out for my connection at 300kiB/s although certainly not running anywhere near that rate. I see the Peers only range from 1-9 ETA at about 21 hours currently. WOW! Thankyou for you assistance! You cannot combine two torrents , no . I'am not sure about the blockchain that you are downloading , you may wanna finish downloading it then try what I said above if didn't work try to download from the link that I gave you , it's what I'am using and it's working fine without any issues . Title: Re: [ANN] Bitcoin blockchain data torrent Post by: c4p0ne on January 20, 2015, 02:59:19 PM Upgraded to 0.10. Now receiving "No block source available". :-\ Whoops, simply doing a -reindex fixed the problem. RC3 Stops the crash-on-exit too. :) Title: Re: [ANN] Bitcoin blockchain data torrent= need some help please Post by: BitCoinCool on January 21, 2015, 05:04:21 PM Well Thank you for the advise and assistance,
The Torrent I was working from finally did finish up. By all accounts it's apparently kept up to date. after complete, I copied the downladed 21G file into the App Data file as instructed (windows), then restarted Bitcoin core. Core is "stuck". It hangs at 35 weeks "Syncing". When I peek at the Debug log- it repeats Data already processed. this is sort of a hang? I cant get it to run through the blocks any quicker... Ive tried close, restart, same. Should I snap a shot of the debug log or does anyone know a work around? Any assistance greatly appreciated...Ive been working daily on this since Jan. 14. Title: Re: [ANN] Bitcoin blockchain data torrent= need some help please Post by: Madness on January 21, 2015, 05:47:32 PM Well Thank you for the advise and assistance, The Torrent I was working from finally did finish up. By all accounts it's apparently kept up to date. after complete, I copied the downladed 21G file into the App Data file as instructed (windows), then restarted Bitcoin core. Core is "stuck". It hangs at 35 weeks "Syncing". When I peek at the Debug log- it repeats Data already processed. this is sort of a hang? I cant get it to run through the blocks any quicker... Ive tried close, restart, same. Should I snap a shot of the debug log or does anyone know a work around? Any assistance greatly appreciated...Ive been working daily on this since Jan. 14. Are you sure about that mate , Have you waited enough because It was Importing blocks from torrent file then when It check & see that there is some missing files (not updated file) , It start Synchrozining with the network , so basically Importing Blocks is a lot faster then Synchronizing with the network and depends on your internet speed . Simply try to wait some time and see if anything changes . If the problem consists to happen, simply take a backup of the 21 GB file , Unistall Bitcoin Core (and remove all AppData Files) then Reinstall it once again and put the Bootstrap.dat on the AppData directory and launch. It should work ... I got it stuck last time too and after doing this it worked fine ;D Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BitCoinCool on January 21, 2015, 06:00:24 PM Thanks,I dreaded needing to do that.
I was so hoping it would simply WORK Sadly, Im beginning to have serious doubts about my entire btc involvement, thinking it's perhaps just for serious computer enthusiasts, those in the industry only. i do mean sadly. many, so many of us just do not have the blocks of time this requires. so disappointing. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on January 21, 2015, 06:08:33 PM 0.10 fixes this anyways and is going to be released very soon.
Also it might very well be that you already synced with the blockchain beyond what the torrent contains (I'm not so sure what you mean by the "I already have 89% done") and just slowed down your internet connection by downloading both more recent blocks via bitcoin-core AND the initial set of older blocks via BitTorrent. As long as you are connected to the Bitcoin network, just let your client sync and it will eventually catch up. By the way, initial sync is very often CPU bound, so if you have an old machine or are doing heavy computations on the side, you'll also often be limited by that, importing blocks "slowly" is maybe the fastest your PC can handle. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: anx on February 10, 2015, 02:00:25 PM added 1Gbit/s seed from finland ;) Will seed fullspeed 24/7(best effort) ;D
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on February 16, 2015, 03:24:13 PM Guys no more torrent for .10, just run nodes
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: manselr on February 16, 2015, 03:26:18 PM Guys no more torrent for .10, just run nodes Can I install .10 on top my current last version installation or I need to have a fresh install and download the damn blockchain again? I HOPE NOT.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on February 16, 2015, 03:34:55 PM Can I install .10 on top my current last version installation or I need to have a fresh install and download the damn blockchain again? I HOPE NOT. Yes. Quote from: https://bitcoin.org/en/release/v0.10.0 If you are running an older version, shut it down. Wait until it has completely shut down (which might take a few minutes for older versions), then run the installer (on Windows) or just copy over /Applications/Bitcoin-Qt (on Mac) or bitcoind/bitcoin-qt (on Linux). Release 0.10.0 makes use of headers-first synchronization and parallel block download (see further), the block files and databases are not backwards-compatible with older versions of Bitcoin Core or other software:
Bitcoin Core now uses ‘headers-first synchronization’. This means that we first ask peers for block headers (a total of 27 megabytes, as of December 2014) and validate those. In a second stage, when the headers have been discovered, we download the blocks. However, as we already know about the whole chain in advance, the blocks can be downloaded in parallel from all available peers. In practice, this means a much faster and more robust synchronization. On recent hardware with a decent network link, it can be as little as 3 hours for an initial full synchronization. You may notice a slower progress in the very first few minutes, when headers are still being fetched and verified, but it should gain speed afterwards. -MZ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on February 16, 2015, 03:46:59 PM Shut down the torrents guys. We're done here. Mission accomplished.
https://bitcoin.org/en/download Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pereira4 on February 16, 2015, 04:10:42 PM Yess cant wait to arrive home and try this. I was struggling to run a node, maybe if they did a good job the client is less bloated now and more people like me can run nodes.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on February 16, 2015, 04:30:58 PM Yess cant wait to arrive home and try this. I was struggling to run a node, maybe if they did a good job the client is less bloated now and more people like me can run nodes. Well, with version 0.1 synced: $ du -h .bitcoin/ 16K .bitcoin/database 717M .bitcoin/chainstate 48M .bitcoin/blocks/index 33G .bitcoin/blocks 50G .bitcoin/ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on February 16, 2015, 04:31:45 PM Yess cant wait to arrive home and try this. I was struggling to run a node, maybe if they did a good job the client is less bloated now and more people like me can run nodes. Well, with version 0.1 synced: $ du -h .bitcoin/ 16K .bitcoin/database 717M .bitcoin/chainstate 48M .bitcoin/blocks/index 33G .bitcoin/blocks 50G .bitcoin/ It may have duplicated the database, start fresh Mine's 33.4 GB Title: Re: [ANN] Bitcoin blockchain data torrent Post by: pedrog on February 16, 2015, 04:38:25 PM Yess cant wait to arrive home and try this. I was struggling to run a node, maybe if they did a good job the client is less bloated now and more people like me can run nodes. Well, with version 0.1 synced: $ du -h .bitcoin/ 16K .bitcoin/database 717M .bitcoin/chainstate 48M .bitcoin/blocks/index 33G .bitcoin/blocks 50G .bitcoin/ It may have duplicated the database, start fresh Mine's 33.4 GB Still had the bootstrap.dat.old file in there, now it's ~34G. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dandana on February 17, 2015, 04:20:24 PM questions :
1) bootstrap is working on bitcoin-qt 0.10.0 ?? if yes what is the folder that bootstrap must be replaced ?. Thanks and sorry for newbie question .. 2) best nodes to update the blockchain faster ?? im 6 years behind ... it will take forever ... Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Newar on February 17, 2015, 04:28:35 PM questions : 1) bootstrap is working on bitcoin-qt 0.10.0 ?? if yes what is the folder that bootstrap must be replaced ?. Thanks and sorry for newbie question .. 2) best nodes to update the blockchain faster ?? im 6 years behind ... it will take forever ... 1) It might, but it doesn't matter. 2( Check shorena's list: https://bitcointalk.org/index.php?topic=929353.msg10456173#msg10456173 , but again it doesn't matter that much anymore. It will not take forever. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BillyBobZorton on February 17, 2015, 04:45:57 PM Anyone else is scared everytime they update? I always create 3 more backups of the wallet just in case.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Newar on February 17, 2015, 04:53:00 PM Anyone else is scared everytime they update? I always create 3 more backups of the wallet just in case. Of course. It's part of "being your own bank". Backing up is a good thing. *somethingelseIwantedtopost,butfogrot* Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on February 17, 2015, 05:09:42 PM Since v0.10 is rolled, it will give any advantage to take chain from torrent?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Muhammed Zakir on February 17, 2015, 05:23:03 PM Since v0.10 is rolled, it will give any advantage to take chain from torrent? I think no. Guys no more torrent for .10, just run nodes -MZ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on February 17, 2015, 05:28:09 PM Maybe that your blocks will be more in order? Just getting 0.10.0 should be enough though, it is faster than loading the torrent and if you want to transfer blocks via USB stick, you don't need the torrent for that anyways.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on February 17, 2015, 08:08:04 PM AFIK when chain is loaded and UTXO database is created and updated every block, daemon is not looking to old data from chain, so order doesn't matter much.
Only when RPC getblock happen or another node ask about old data. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Lauda on April 16, 2015, 10:15:26 AM Since v0.10 is rolled, it will give any advantage to take chain from torrent? I think no. Guys no more torrent for .10, just run nodes -MZ Syncing from the begging still takes quite some time; pruning is needed. Update: Shorena you make a valid point. There is no need for me to make further unnecessary posts here. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on April 16, 2015, 10:23:04 AM Since v0.10 is rolled, it will give any advantage to take chain from torrent? I think no. Guys no more torrent for .10, just run nodes -MZ Syncing from the begging still takes quite some time; pruning is needed. Under the assumption that you do not have horrible peers when connected, using the torrent slows you down. The torrent is just a data download and the data has to be verified. With 0.10. you can download from several sources at once and should be able to max our your connection same as with a torrent, but the machine can verify the blocks at the same time. With the torrent you would have to download first and verify later. Thus its typically faster to use the client. As with everything it depends on your specific situation and environment if this is true or not obviously. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on April 16, 2015, 09:49:36 PM Torrent is now obsolete.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on April 17, 2015, 11:16:39 AM Topic should be locked and OP updated.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: McDonald on April 22, 2015, 09:38:50 PM Hi, i am very new, op, i want to join the bitcoin mining, but where do i start, since i here so many things here.
some said i must download multitool, and blockchain client n now here i see there are so many things mentioned. where can a newbie start, please, instead of downloading the whole thing that we can not afford in terms of data plan, what do we do as a newbies. Hope someone will be so petient to explain to me the step by step and joining the different pools as well. Thank you so much in advance. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on April 22, 2015, 10:38:05 PM Hi, i am very new, op, i want to join the bitcoin mining, but where do i start, since i here so many things here. some said i must download multitool, and blockchain client n now here i see there are so many things mentioned. where can a newbie start, please, instead of downloading the whole thing that we can not afford in terms of data plan, what do we do as a newbies. Hope someone will be so petient to explain to me the step by step and joining the different pools as well. Thank you so much in advance. You dont need bitcoin core to mine with a pool. Depending on the hardware you use mining is probably not profitable for you. See this section on profitability -> https://bitcointalk.org/index.php?board=81.0 Different mining software can be found here -> https://bitcointalk.org/index.php?board=42.0 If you need help regarding mining this would be the section -> https://bitcointalk.org/index.php?board=40.0 And finally pools are discussed here -> https://bitcointalk.org/index.php?board=41.0 You will certainly need a wallet sooner or later, but bitcoin core might not be the wallet for you. There are many different wallets and many of them do not require a full copy of the blockchain. -> https://bitcoin.org/en/choose-your-wallet Title: Re: [ANN] Bitcoin blockchain data torrent Post by: aniscartujo on April 28, 2015, 08:42:02 PM Updated 27 November 2015 @ Block ~385577 data torrent (with full txindex)
Code: Torrent: Details on it's own thread: https://bitcointalk.org/index.php?topic=1041329.0 (https://bitcointalk.org/index.php?topic=1041329.0) Donations and tips to: 1GyKr6hS2FygXXcSe5yUww8u7Qwzt9j6rb Aniscartujo. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on April 28, 2015, 08:48:25 PM April 2015 updated data torrent (with full txindex) [...] Details on it's own thread: https://bitcointalk.org/index.php?topic=1041329.0 (https://bitcointalk.org/index.php?topic=1041329.0) Donations and tips to: XXX Aniscartujo. Who are you and why should I trust you to build a txindex(!) correctly? Any error in there could lead to double spends or other issues... and also you seem to have compressed this file so there is no way to verify the contents without downloading it in full. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: aniscartujo on April 28, 2015, 10:13:22 PM April 2015 updated data torrent (with full txindex) [...] Details on it's own thread: https://bitcointalk.org/index.php?topic=1041329.0 (https://bitcointalk.org/index.php?topic=1041329.0) Donations and tips to: XXX Aniscartujo. Who are you and why should I trust you to build a txindex(!) correctly? Any error in there could lead to double spends or other issues... and also you seem to have compressed this file so there is no way to verify the contents without downloading it in full. I am a bitcoin lover just like any other user on this forum... I compressed the files to save 10GB of bandwidth on each download. Yes you don't have to trust me or any other new user. I only think that is better to give something instead of "Hello, I am new here..." message as my first post. I have a 1GBPs server with plenty of space, so if some one want to save hours/days on a new installation of the bitcoin client (and does not have the files on hand) give it a try (and verify the authenticity of the file) Donations and tips to: 1GyKr6hS2FygXXcSe5yUww8u7Qwzt9j6rb Aniscartujo. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on April 29, 2015, 12:19:59 PM OP should really be edited and topic locked.
As of 0.10 there is no sense to make/download/seed torrents containing blockchain! Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jgarzik on April 29, 2015, 04:37:46 PM Just added a note to the OP.
The Bitcoin Core client is faster and more secure and is the preferred option. The torrent will continue to be updated periodically for academic research and development purposes, as some secondary usefulness does remain. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sd on June 06, 2015, 09:15:44 AM Seed Ratio: 1809
Current Bandwidth: 650kB/s Connected to 5 peers I was going to shut my seed down but I won't just yet. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hodedowe on July 02, 2015, 01:20:00 PM Some ppl keep saying core v0.10.xx makes this obsolete - NOT TRUE!
My index corrupted and it took me over 4 days to sync again. Torrent was only 8 hours when it had more peers. v00.10.xx is not the fix-all it was claimed to be. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on July 02, 2015, 03:20:37 PM If your index corrupts it just needs to be rebuilt, there is no need to download anything. Also 0.10.0 and newer will download while syncing (which is the limiting part on most machines out there). If you speed up the download step, you don't measure the whole time it takes to get up to sync...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: seoincorporation on August 21, 2015, 07:07:16 PM Thx! after 3 days of sync. i search for a torrent like this and found this thread.
This download that 22.57G will take me only 14 hours ;D Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on August 22, 2015, 09:25:15 AM Thx! after 3 days of sync. i search for a torrent like this and found this thread. Y U NO use v0.10+ ???This download that 22.57G will take me only 14 hours ;D Title: Re: [ANN] Bitcoin blockchain data torrent Post by: bitpop on August 22, 2015, 09:33:39 AM Thx! after 3 days of sync. i search for a torrent like this and found this thread. Y U NO use v0.10+ ???This download that 22.57G will take me only 14 hours ;D He might be but doesn't realize the torrent will still require processing Title: Re: [ANN] Bitcoin blockchain data torrent Post by: master-P on September 16, 2015, 12:30:26 AM Is it normal for my bitcoin core to take upwards of 6-8 hours to reindex after my machine crashes? I am running v0.10.0.
Is there a faster alternative for reindexing so I can access my armory wallet without having to wait half a day or over night? Prior to v0.10.0, I use to use the torrent to save some time but the torrent was very outdated back then. And now I'm seeing posts stating the torrent is obsolete? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on September 16, 2015, 01:33:27 AM Is it normal for my bitcoin core to take upwards of 6-8 hours to reindex after my machine crashes? I am running v0.10.0. The torrent shouldn't affect reindexing. You already have all of the blocks downloaded, so the torrent is useless for you. The reindex can only be sped up with either code modifications or getting better hardware.Is there a faster alternative for reindexing so I can access my armory wallet without having to wait half a day or over night? Prior to v0.10.0, I use to use the torrent to save some time but the torrent was very outdated back then. And now I'm seeing posts stating the torrent is obsolete? Also, the torrent is already obsolete as it is both outdated and in v0.10+ headers first synchronization makes Bitcoin Core Download (but not index) the blockchain faster. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: master-P on September 16, 2015, 01:52:25 AM Is it normal for my bitcoin core to take upwards of 6-8 hours to reindex after my machine crashes? I am running v0.10.0. The torrent shouldn't affect reindexing. You already have all of the blocks downloaded, so the torrent is useless for you. The reindex can only be sped up with either code modifications or getting better hardware.Is there a faster alternative for reindexing so I can access my armory wallet without having to wait half a day or over night? Prior to v0.10.0, I use to use the torrent to save some time but the torrent was very outdated back then. And now I'm seeing posts stating the torrent is obsolete? Also, the torrent is already obsolete as it is both outdated and in v0.10+ headers first synchronization makes Bitcoin Core Download (but not index) the blockchain faster. Thanks for the info. This is pretty much my biggest gripe with Bitcoin. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hl5460 on November 02, 2015, 07:14:09 AM The torrent is still a faster way of sync for the newbies. I have recommended the seed to the Chinese:
为什么我同步时在第99周钱卡主了 http://8btc.com/thread-24689-1-1.html (出处: 巴比特论坛) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on November 02, 2015, 02:33:18 PM It is not.
You have grab torrent, copy it to proper directory, wait for reindex. Not using torrent you just need to run Core and wait for download and index. Because of parallel and non-linear downloading of chain from peers, at start it seems to be slow. Anyway, not having SSD still need days to do 1st sync. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on November 02, 2015, 08:11:54 PM The torrent is still a faster way of sync for the newbies. I have recommended the seed to the Chinese: With new versions, the torrent is ABSOLUTELY NOT FASTER. It is faster and easier to allow Bitcoin Core to sync normally, no need to download a massive file, and the sync is faster due to headers-first synchronization.为什么我同步时在第99周钱卡主了 http://8btc.com/thread-24689-1-1.html (出处: 巴比特论坛) Title: Re: [ANN] Bitcoin blockchain data torrent Post by: PatrickMacH on December 17, 2015, 02:52:18 AM The torrent is still a faster way of sync for the newbies. I have recommended the seed to the Chinese: With new versions, the torrent is ABSOLUTELY NOT FASTER. It is faster and easier to allow Bitcoin Core to sync normally, no need to download a massive file, and the sync is faster due to headers-first synchronization.[...] Sorry, but I can not confirm this; at least not if you have access to a very fast internet connection. ;D I've just downloaded the latest block chain (bootstrap.dat: 2015-12-10) from Flo's Press 4u: https://flo.sh/bitcoin-qt-bootstrap-dat/ (https://flo.sh/bitcoin-qt-bootstrap-dat/) uncompressed the zipfile to my ~/.bitcoin application directory and restartet a brand new Bitcoin-Qt v0.11.2. Bitcoin-Qt imported the bootstrap file within minutes. So I'm ready to go (download and unpacking of the bootstrap zip file included) within less than two hours using recent equipment! 8) Just starting the plain Bitcoin-Qt client would have taken many hours if not days to complete the same task :P Nevertheless downloading a bootstrap file may be counterproductive using a slow internet access technology. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on December 17, 2015, 03:01:04 AM Sorry, but I can not confirm this; at least not if you have access to a very fast internet connection. The difference is probably negligible if you have a fast connection. ;D I've just downloaded the latest block chain (bootstrap.dat: 2015-12-10) from Flo's Press 4u: https://flo.sh/bitcoin-qt-bootstrap-dat/ (https://flo.sh/bitcoin-qt-bootstrap-dat/) That is not the actual official bootstrap.dat. That is the file produced by a third party and has also been compressed from 50+ Gb to around 35+. The smaller size makes it faster to download (duh). I was referring to the official bootstrap.dat which is now obsolete and is still the full size of the blockchain, not compressed.uncompressed the zipfile to my ~/.bitcoin application directory and restartet a brand new Bitcoin-Qt v0.11.2. Bitcoin-Qt imported the bootstrap file within minutes. So I'm ready to go (download and unpacking of the bootstrap zip file included) within less than two hours using recent equipment! 8) Just starting the plain Bitcoin-Qt client would have taken many hours if not days to complete the same task :P Nevertheless downloading a bootstrap file may be counterproductive using a slow internet access technology. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: PatrickMacH on December 17, 2015, 03:09:21 AM That is not the actual official bootstrap.dat. That is the file produced by a third party and has also been compressed from 50+ Gb to around 35+. The smaller size makes it faster to download (duh). I was referring to the official bootstrap.dat which is now obsolete and is still the full size of the blockchain, not compressed. It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory.Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on December 17, 2015, 03:27:49 AM It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory. The actual bootstrap.dat is not compressed. The one you are downloading is, but it isn't the official one that was maintained by jgarzik.Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. There is talk on the mailing list about block compression and ways to speed up syncing, but I don't think that any of it will be coming in the next release. It either isn't ready or there isn't any particular need for it. Using the actual bootstrap.dat (not the one that you used) is not actually faster than simply letting it sync.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hamiltino on December 25, 2015, 11:41:00 PM It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory. The actual bootstrap.dat is not compressed. The one you are downloading is, but it isn't the official one that was maintained by jgarzik.Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. There is talk on the mailing list about block compression and ways to speed up syncing, but I don't think that any of it will be coming in the next release. It either isn't ready or there isn't any particular need for it. Using the actual bootstrap.dat (not the one that you used) is not actually faster than simply letting it sync.stop talking out of ur ass, im getting speeds up to 5mb/s with the torrent, i can't get anything near this with the client. This has been a huge time saver for me. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on December 26, 2015, 12:00:33 AM It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory. The actual bootstrap.dat is not compressed. The one you are downloading is, but it isn't the official one that was maintained by jgarzik.Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. There is talk on the mailing list about block compression and ways to speed up syncing, but I don't think that any of it will be coming in the next release. It either isn't ready or there isn't any particular need for it. Using the actual bootstrap.dat (not the one that you used) is not actually faster than simply letting it sync.stop talking out of ur ass, im getting speeds up to 5mb/s with the torrent, i can't get anything near this with the client. This has been a huge time saver for me. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rienelber on December 26, 2015, 12:06:21 AM quote author=knightdk link=topic=145386.msg13357972#msg13357972 date=1451088033]
quote author=hamiltino link=topic=145386.msg13357882#msg13357882 date=1451086860] quote author=knightdk link=topic=145386.msg13272697#msg13272697 date=1450322869] quote author=PatrickMacH link=topic=145386.msg13272577#msg13272577 date=1450321761] It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory. /quote] The actual bootstrap.dat is not compressed. The one you are downloading is, but it isn't the official one that was maintained by jgarzik. quote author=PatrickMacH link=topic=145386.msg13272577#msg13272577 date=1450321761] Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. /quote] There is talk on the mailing list about block compression and ways to speed up syncing, but I don't think that any of it will be coming in the next release. It either isn't ready or there isn't any particular need for it. Using the actual bootstrap.dat (not the one that you used) is not actually faster than simply letting it sync. /quote] stop talking out of ur ass, im getting speeds up to 5mb/s with the torrent, i can't get anything near this with the client. This has been a huge time saver for me. /quote] I'm not talking out of my ass. From my experience it has been faster to let the client (version 0.10+) sync by itself than it is to download the bootstrap.dat and to import that. /quote] This just makes no sense, since torrent clients download at full ISP speed, while the btc server is subject to several bottlenecks. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on December 26, 2015, 12:14:11 AM This just makes no sense, since torrent clients download at full ISP speed, while the btc server is subject to several bottlenecks. Bottlenecks where? Bitcoin nodes download at full ISP speed as well. It doesn't have the additional bottleneck of having to verify all of the blocks after the download. The node will verify the blocks as they are downloaded, not after they have all been downloaded.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hamiltino on December 26, 2015, 01:03:35 AM It's a standard zip compressed bootstrap.dat (https://flo.sh/bitcoin-qt-bootstrap-dat/) file, combining all blk*.dat files out of the blocks directory. The actual bootstrap.dat is not compressed. The one you are downloading is, but it isn't the official one that was maintained by jgarzik.Maybe we should discuss adding a zip level compression (or better suitable) algorithm to the Bitcoin-Qt client to reduce the amout of data needed to be transferred to update the block chain. There is talk on the mailing list about block compression and ways to speed up syncing, but I don't think that any of it will be coming in the next release. It either isn't ready or there isn't any particular need for it. Using the actual bootstrap.dat (not the one that you used) is not actually faster than simply letting it sync.stop talking out of ur ass, im getting speeds up to 5mb/s with the torrent, i can't get anything near this with the client. This has been a huge time saver for me. I guess it depends on your location and connection speeds. I still think the torrent is useful for some, not all. It's also nice to have a single file that i can use whenever i need to quickly bootstrap my client. Also when downloading the blockchain with the client i get corrupt database error's all the time, forcing me to constantly reindex the blockchain... what gives? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Chancellor on December 27, 2015, 05:36:06 PM I've just set up a fresh full node using 0.11.2 Core client. Syncing the whole blockchain took 4 days. What is interesting, downloading blocks was not a bottleneck. My 20 Mbit/s connection was never fully utilized. What is slow, is population of the database and probably building base of UTXO. I admit that my setup is rather slow: Core2Duo @ 2.4 GHz and external 1 TB HDD (5400 rpm) on USB 2.0. With this setup HDD seems to be the major bottleneck.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on December 28, 2015, 10:24:32 PM Is there a way that I can install an old verstion of bitcoin core.
Import the torrent file into that and then update the software to the latest version. Would this work better to syncronise to the network, as I have been told that, when switching between versions, the initial blockchain import is not required? Have I got this correct? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: BillyBobZorton on December 28, 2015, 10:26:26 PM Is there a way that I can install an old verstion of bitcoin core. Import the torrent file into that and then update the software to the latest version. Would this work better to syncronise to the network, as I have been told that, when switching between versions, the initial blockchain import is not required? Have I got this correct? I think t's best that you download the entire blockchain from scratch no matter what, it's worth investing into the extra time for the extra security. Why do you want to install an old version anyway tho? Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on December 28, 2015, 10:39:55 PM Is there a way that I can install an old verstion of bitcoin core. Import the torrent file into that and then update the software to the latest version. Would this work better to syncronise to the network, as I have been told that, when switching between versions, the initial blockchain import is not required? Have I got this correct? I think t's best that you download the entire blockchain from scratch no matter what, it's worth investing into the extra time for the extra security. Why do you want to install an old version anyway tho? Once the old software is installed, and the blockchain downloaded. I can then update it to the new wallet! It will take much less time and there is no need to re syncronise the blockchain after this is done with the newer version. It will just runn the veryify blocks process. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on December 28, 2015, 10:53:58 PM NEW version is syncing FASTER than ANY older one!
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: achow101 on December 29, 2015, 03:21:22 AM Is there a way that I can install an old verstion of bitcoin core. Import the torrent file into that and then update the software to the latest version. Would this work better to syncronise to the network, as I have been told that, when switching between versions, the initial blockchain import is not required? Have I got this correct? I think t's best that you download the entire blockchain from scratch no matter what, it's worth investing into the extra time for the extra security. Why do you want to install an old version anyway tho? Once the old software is installed, and the blockchain downloaded. I can then update it to the new wallet! It will take much less time and there is no need to re syncronise the blockchain after this is done with the newer version. It will just runn the veryify blocks process. However, if you insist on installing an old client and upgrading, here is a copy of 0.9.4 that I built and uploaded: https://github.com/achow101/bitcoin/releases/tag/v0.9.4 Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Amph on December 29, 2015, 07:45:17 AM NEW version is syncing FASTER than ANY older one! the new version 0.12 will synch even faster, thanks to the capacity increased, which will reduce orphan, and reduce bandwidth Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on December 29, 2015, 11:29:12 AM HDD is still bottleneck, my system shows 10-20MB of data written every block synced...
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: hamiltino on January 04, 2016, 06:13:04 PM I'm currently maintaining an up to date bitcoin blockchain data torrent here: https://bitcointalk.org/index.php?topic=1310261.0
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: washuu on January 14, 2016, 11:00:52 AM With new versions, the torrent is ABSOLUTELY NOT FASTER. It is faster and easier to allow Bitcoin Core to sync normally, no need to download a massive file, and the sync is faster due to headers-first synchronization. Let me share my story. I have a small NAS, used also as set-top box to my TV. It runs debian. I decided to give the Bitcoin a try, and set up a node - I have plenty of space there, and this box is used sporadically. I downloaded fresh version of Bitcoin (at that moment, 0.11.02), and started downloading the blocks normally. I have a decent speed to the internet. I took over a month to download the whole blockchain, and I have logs to prove it. I have monitored its progress - bitcoind used just a small bandwith, but always 100% of my CPU, on the NAS. It os not very powerful CPU, I admit, so I wasn't surprised. It was the computation that caused the blockchain to load slowly. When it finished, and started running "normally", the CPU consumption was about 20-40%. It was quite expected. But I decided to give the torrent a try, just for sake of comparison. The torrent I took from the above linked thread. The torrent downloaded on the same box, with the same CPU and network, in about 7 hours. Then, I needed to download missing blocks - it took about 36 hours. In total - 42 hours. In both cases the blockchain is about 62 GB big. The MD5 of the files are different, though. Now my points: - there are computers with slower CPU. Keep this in mind. My case was extreme, but it's just proof, that CPU is also very important during downloading the blockchain, and people having problems with slow downloads perhaps have probelem with CPU, not network. - precomputation is just reasonable. Why everyone should compute the same blocks every time they start a new node? - if you prepare "certified" blockchain (can be GPG signed, etc.), you will show the people that you CARE about them, and about their time, and freedom of choice of downloading method. This is important for people that are hesitating about running a bitcoin daemon. Thanks for reading. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: whizz94 on January 14, 2016, 11:18:45 AM January 11th 2016 blockchain full download
~~~~~~~~~~~~~~~~~~~~~~~~~ Here I report my most recent performance as it will help others to decide what hardware is sufficient. It was to a VBOX virtual machine in linux on a quad-core i5 throttled to <75% x 4cpu cores. Download of the whole blockchain from block 1 to present took about 2 days. /.bitcoin/ is now about 65GB 2009 to 2013 parts of the blockchain maxed out the 4x cpu usage. After that it slowed down, with 4x cpu usage decreased from about 95% x 4 x 2.3 GHz to (4 x 2.3 GHz about 40% of the time). I suspect that the most recent 40GB of the blockchain were synching at a rate limited by my HDD rw speed and seek time, so a faster HDD such as a SSD would be the best available speedup, and might get a full blockchain download down to less than 40 hours. What have others been seeing? I don't think that the original bootstrap.dat is much help now as it only does the "easy" third at the start of the blockchain. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: shorena on January 14, 2016, 02:29:13 PM -story- Now my points: - there are computers with slower CPU. Keep this in mind. My case was extreme, but it's just proof, that CPU is also very important during downloading the blockchain, and people having problems with slow downloads perhaps have probelem with CPU, not network. Yes, the overal speed depends on more than just bandwith. - precomputation is just reasonable. Why everyone should compute the same blocks every time they start a new node? You either used the "bootstrap.dat" in which case you did not safe any computation time, but rather wasted it by seperating download and verification. From the times you states and "precomputation" however I assume you downloaded a preverified blockchain. This is naturally faster, because you dont do all the work. Thus the comparisson is invalid and you need to trust the other party to not have messed with the blockchain. You should verifiy the blocks to avoid this exact problem, trusting someone else. The same way you verify the binaries you download or the signed message you receive. - if you prepare "certified" blockchain (can be GPG signed, etc.), you will show the people that you CARE about them, and about their time, and freedom of choice of downloading method. This is important for people that are hesitating about running a bitcoin daemon. Thanks for reading. Which will require you to trust that person and their ability to secure their PGP key. People are not hesitating to run a full node because of the initial time it takes, but because of the constant time it needs to download and verify data. If it would just be 1-3 days (relativly modern desktop/laptop computer) it would not be an issue. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: washuu on January 16, 2016, 09:37:59 PM You either used the "bootstrap.dat" in which case you did not safe any computation time, but rather wasted it by seperating download and verification. From the times you states and "precomputation" however I assume you downloaded a preverified blockchain. This is naturally faster, because you dont do all the work. Thus the comparisson is invalid and you need to trust the other party to not have messed with the blockchain. You should verifiy the blocks to avoid this exact problem, trusting someone else. The same way you verify the binaries you download or the signed message you receive. That's exactly my point - why would I have needed trust someone else, if I had had the opportunity to download pre-verified blockchain as a package, certified by bitcoin.org ? That's just giving the people another way of getting bitcoin node up and running very fast. Precomputing means not only wasted CPU cycles, but also HDD operations, as there was reported that every block requires much more HDD transfer, than just size of the blocks. There still will be option to run bitcoind from scratch, for any people that just want to "fire and forget", and that is good. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on January 16, 2016, 11:33:02 PM January 11th 2016 blockchain full download ~~~~~~~~~~~~~~~~~~~~~~~~~ Here I report my most recent performance as it will help others to decide what hardware is sufficient. It was to a VBOX virtual machine in linux on a quad-core i5 throttled to <75% x 4cpu cores. Download of the whole blockchain from block 1 to present took about 2 days. /.bitcoin/ is now about 65GB 2009 to 2013 parts of the blockchain maxed out the 4x cpu usage. After that it slowed down, with 4x cpu usage decreased from about 95% x 4 x 2.3 GHz to (4 x 2.3 GHz about 40% of the time). I suspect that the most recent 40GB of the blockchain were synching at a rate limited by my HDD rw speed and seek time, so a faster HDD such as a SSD would be the best available speedup, and might get a full blockchain download down to less that 40 hours. What have others been seeing? I don't think that the original bootstrap.dat is much help now as it only does the "easy" third at the start of the blockchain. I was considering running the bitcoin core of a hard drive on a raspbery pi and transferrring the data over afterward to my laptop. Would this save power? It only has to power a hard drive, raspberry pi and WiFi adapter. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: whizz94 on January 17, 2016, 09:40:36 AM Definitely no for BTC.
For the whole month of August I had my quad-core B2 raspberry pi trying to download and sort the whole blockchain to its compiled-from-src bitcoin-qt. It crashed and required bitcoin-qt -reindex several times and in one month of usage never completed the necessary first -reindex task. It seemed to get slower and slower as the number of weeks remaining decreased to 50 wk, (synched up to mid-2014) and eventually I started using a spare i5 instead, which overtook the rPi in a couple of days. In 2016, I have this rPi being an unobtanium-qt node and a couple of other altcoins too. They are all a bit underused but seem to have faster confirmation times than BTC and be better suited to (if my neighbours were to pay pocket money for mowing the lawn). I've just tested an unobtanium electrum-uno lightweight wallet which showed "pending" within the same minute as sending a test transaction from the rPi node via the international UNO blockchain to .. the other PC across my desk. If you are serious about power saving then try something like this by all means, but read around to avoid the various scamcoins and proceeds-of-crime coins which are around. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: dadach on July 16, 2017, 03:46:00 PM so downloading this and importing would take longer than 2 weeks my bitcoin core is indicating?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on July 16, 2017, 04:18:48 PM so downloading this and importing would take longer than 2 weeks my bitcoin core is indicating? Yes, and you might want to look at when one of these was last released. It might not have been for some time considering this thread isn't very active and it's not particularly that useful as the new wallets should load the chain much faster. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: nagobinga on July 18, 2017, 09:04:08 AM Both openbittorrent and publicbt work for me, your "seedboxes" will not be able to BitTorrent traffic and everything you might configure it by the way they do not receive public torrent files / links?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: tave on July 25, 2017, 01:15:29 PM any bootstrap.dat update 2017?
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: OmegaStarScream on July 25, 2017, 01:27:00 PM any bootstrap.dat update 2017? You don't need it anymore and It's no longer as It used to be, It's now slower. If you want to download the blockchain then do it directly from Bitcoin Core, It should take less time If you are running the latest versions. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on August 18, 2017, 07:53:47 AM IMPORTANT NOTE: As of Bitcoin Core version 0.10.0 or later, this torrent is slower than a direct download using the bitcoin P2P protocol & client. This torrent is now only maintained for research and development purposes as a secondary option. Please use Bitcoin Core directly to download the blockchain. This topic can be closed? Some people still asking about thing that is not need for like year.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on August 18, 2017, 07:43:29 PM This topic can be closed? Some people still asking about thing that is not need for like year. Please don't close it. Lots of people with unreliable hardware or network problems are still better off downloading separately from initializing the blockchain storage.There are many people with non-flat-rate network hookups or with over-the-radio hookups with shared IPv4 addresses that continue to download the torrents from this thread. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: rav3n_pl on August 19, 2017, 09:26:17 AM You do realize, that data in torrent are WAY outdated and new node need get lots of data anyway?
It is NOT good way to bootstrap node. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: 2112 on August 22, 2017, 10:59:08 AM You do realize, that data in torrent are WAY outdated and new node need get lots of data anyway? So what? It is and it forever will be a proper subset of the valid data. This torrent is sufficient to reliably trigger bugs in certain popular/cheap flash storage devices. This alone would make it an useful test case for at least decade, maybe more.Also, there are (non-English language) papers that use this torrent for performance comparison of various file systems, alternate storage engines and file/partition layouts. It is NOT good way to bootstrap node. This is just your personal limitation that you can't or won't understand why separating over-the-WAN download from over-the-LAN initialization is and will be useful troubleshooting and testing tool.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Sukrim on August 23, 2017, 09:07:12 PM Also, there are (non-English language) papers that use this torrent for performance comparison of various file systems, alternate storage engines and file/partition layouts. Got some links? Also the ad-hominem is not really useful, using the data in this torrent is objectively a really bad way to bootstrap your node in case you just want to get it up and running as fast as possible.Title: Re: [ANN] Bitcoin blockchain data torrent Post by: miguelmorales85 on September 10, 2017, 03:07:07 PM there are some people who has contrary belief to what is better:
download the entire boostrap.dat OR start a node and download the data from other nodes. I wonder if someone has the technical knowledge to clarify this Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on September 10, 2017, 03:24:29 PM there are some people who has contrary belief to what is better: download the entire boostrap.dat OR start a node and download the data from other nodes. I wonder if someone has the technical knowledge to clarify this Until about version 0.10.0 it was much faster to download the bootstrap.dat file. Since that release of version 0.10.0 it was faster just to leave a node to download it unless you have a dial-up modem or limited internet access (but it'd have to be less than about 100kbps to slow if down by an unreasonable amount that makes downloading impossible). If you have an internet speed that sliw however, if wouldn't be productive to run a node anyway and you may as well use a light wallet instead. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Jully Bells on October 01, 2017, 03:19:41 AM Torrents make heavy use of checksumming/hashing, so while in the block chain you need to have all previous headers to verify the current one, in a torrent file you just need any chunk of data. Other comments were saying that a feature was being implemented so that all of the headers would be downloaded first and the actual blocks could then be downloaded in any order. I'm guessing the client pretty much has to download the headers serially still in order for the distributed nature to continue working. Serial downloading of the blockchain probably makes it easier for the client to check that nobody is bullshitting them with an incorrect version of the blockchain.
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: sunk818 on November 14, 2017, 10:08:20 PM Active torrents. Sharing Nov 7, 2017 - https://blockchaindownload.nl/en/
Title: Re: [ANN] Bitcoin blockchain data torrent Post by: SangkuniBird on November 16, 2017, 11:23:58 PM It is very convenient, when I install bitcoin-qt on another device, it takes about an hour instead of almost a week :-[ Title: Re: [ANN] Bitcoin blockchain data torrent Post by: jackg on November 22, 2017, 12:35:16 AM Torrents make heavy use of checksumming/hashing, so while in the block chain you need to have all previous headers to verify the current one, in a torrent file you just need any chunk of data. Other comments were saying that a feature was being implemented so that all of the headers would be downloaded first and the actual blocks could then be downloaded in any order. I'm guessing the client pretty much has to download the headers serially still in order for the distributed nature to continue working. Serial downloading of the blockchain probably makes it easier for the client to check that nobody is bullshitting them with an incorrect version of the blockchain. Unless you're talking about parallel processes, I don't see how what you're suggesting would increase the download time. The headers are downloaded first though so that could be what it does... (But as it tracks the height and suggests the number of blocks downloaded this probably doesnt happen). Also, a feature like that would take about longer and more CPU power IMO as it has to check whether it's done a file and call each block relating to the header randomly. Title: Re: [ANN] Bitcoin blockchain data torrent Post by: Inggridpratiwi on January 31, 2018, 06:35:22 AM I will only say that I have maintained several torrent sites since Jeff started this thread. Activity initially zilch.
In the last few weeks, upload bandwidth has skyrocketed. |
