Title: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 06, 2017, 03:35:25 PM i am trying to get bitcoin addresses from my blockchain stored on server.
my bitcoin is up to date. index mode is not enabled, as i dont want UTXO database. i tried using https://github.com/znort987/blockparser compiled it succesfully. strated like this Code: [root@blockparser]# env BLOCKCHAIN_DIR="/home/user2/" ./parser allBalances > allBalances.txt but it crashes in the middle., or some times at the end., i tried running it many times., previously i got memory related error., so freed up memory and increased swap on my server. then tried running it again right now i am getting Code: info: 481823 blocks, 295.351 MegaAddrs , i counted and looks like it aborts when 2000 blocks are remaining. i am not the only one getting this error.. https://github.com/znort987/blockparser/issues/65 so what you guys are using ? to get data extracted from blockchain files. i have 64 gigs of ram, i7 , ssd . centos 7 x64 is there any other tool ? optimized ? or any other fork thanks for your time,. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: LoyceV on October 06, 2017, 05:43:40 PM i tried using https://github.com/znort987/blockparser I can't help you fix it, but I can tell you the reason: blockparser is older than SegWit, so it stops at the block in which SegWit got activated.Code: info: 481823 blocks, 295.351 MegaAddrs , BTC.COM mines the 481,823rd block! Segwit is on stage! (https://www.reddit.com/r/Bitcoin/comments/6vnqi2/btccom_mines_the_481823rd_block_segwit_is_on_stage/) If you get it to work, I'd love to have a complete list (in for example CSV-format) of all addresses with their balance. I'd like to play around with it a bit. Update: this post was Merited today, which reminded me to add this: Bitcoin block data available in CSV format (https://bitcointalk.org/index.php?topic=5246271.0) List of all Bitcoin addresses with a balance (https://bitcointalk.org/index.php?topic=5254914.0) List of all Bitcoin addresses ever used (https://bitcointalk.org/index.php?topic=5265993.0) Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 06, 2017, 06:26:41 PM i tried using https://github.com/znort987/blockparser I can't help you fix it, but I can tell you the reason: blockparser is older than SegWit, so it stops at the block in which SegWit got activated.Code: info: 481823 blocks, 295.351 MegaAddrs , BTC.COM mines the 481,823rd block! Segwit is on stage! (https://www.reddit.com/r/Bitcoin/comments/6vnqi2/btccom_mines_the_481823rd_block_segwit_is_on_stage/) If you get it to work, I'd love to have a complete list (in for example CSV-format) of all addresses with their balance. I'd like to play around with it a bit. i can get a list before that block by stopping program., but i am looking for complete upto date list. will post if i get it to work., what changed in segwit ? i mean in block ? so i can try to change it in blockparser source. edit 1: this is the code cauing the fatal error Code: auto upTXHash = p; i am not sure, will it give correct output. if i comment outt that line and recompile and rerun the code., will try anyways. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: amaclin1 on October 06, 2017, 07:03:50 PM what changed in segwit ? i mean in block ? so i can try to change it in blockparser source. Transaction format was changed in segwit. These six words mean that your tool should be fully rewritten. :P Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 07, 2017, 03:45:04 AM what changed in segwit ? i mean in block ? so i can try to change it in blockparser source. Transaction format was changed in segwit. These six words mean that your tool should be fully rewritten. :P thanks then looks like i am better off trying with other tools., edit1 : i tried running it as it is, parsed around 50% blocks and got output file of 4 GB having format like this Code: --------------------------------------------------------------------------- after around 505 lines, btcaddress is screwed . Code: 2500.00111000 a0fc91baff4e19cb9f417cef2f00d2822106b5be 1FgDgWjeCMxrfiiaYnPdvnQG9DcYe6yX1r 5 Thu Apr 2 17:52:36 2015 0 Thu Jan 1 00:00:00 1970 so unless you want hash160, or know how to convert hash160 to btcaddress., this tool is obsolete . Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: BitcoinPC on October 08, 2017, 04:56:15 AM Waste of time, what is the point? It would take you longer or about the same amount of time to steal coins this way than it would to mine Bitcoins using the same equipment. People have tried this time and time again and the results are the same, they give up because it is a fruitless pursuit. There is always someone that thinks they know better than the system and they fail in the end, so please try again.
Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 08, 2017, 05:05:23 AM Waste of time, what is the point? It would take you longer or about the same amount of time to steal coins this way than it would to mine Bitcoins using the same equipment. People have tried this time and time again and the results are the same, they give up because it is a fruitless pursuit. There is always someone that thinks they know better than the system and they fail in the end, so please try again. what makes you think, my method is same as others., remember everyone is unique :P Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: bigvito19 on October 08, 2017, 01:23:11 PM Is there any other way to get hash160 addresses besides using this?
Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 08, 2017, 03:05:22 PM Is there any other way to get hash160 addresses besides using this? you want hash160 or btc address ? Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: bigvito19 on October 08, 2017, 03:34:30 PM I have the btc addresses, I need a way to get the hash160 addresses.
Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 08, 2017, 03:44:22 PM I have the btc addresses, I need a way to get the hash160 addresses. this is what i would use . Code: bool addrToHash160( ref: https://github.com/znort987/blockparser/blob/master/util.cpp#L596-L699 Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: bigvito19 on October 08, 2017, 04:23:54 PM What would be the the steps or cmd line to use that?
I've been trying to compile the parser but having trouble with g++-4.4, what all did you install to get it to get it to work. I'm stuck at unable to locate the g++-4.4 Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 08, 2017, 04:27:53 PM What would be the the steps or cmd line to use that? I've been trying to compile the parser but having trouble with g++-4.4, what all did you install to get it to get it to work. I'm stuck at unable to locate the g++-4.4 i do this for all my centos systems., yum install autoconf automake gcc-c++ libdb4-cxx libdb4-cxx-devel boost-devel openssl-devel but when error occures at the time of compiliing, act accordingly. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: aplistir on October 08, 2017, 05:01:05 PM Waste of time, what is the point? It would take you longer or about the same amount of time to steal coins this way than it would to mine Bitcoins using the same equipment. People have tried this time and time again and the results are the same, they give up because it is a fruitless pursuit. There is always someone that thinks they know better than the system and they fail in the end, so please try again. what makes you think, my method is same as others., remember everyone is unique :PSo you admit you are trying to steal bitcoins? Good luck with that. I don't know, why you need to be able to parse the blockchain yourself though. Why not explore ready made lists of bitcoin addresses. https://bitinfocharts.com/top-100-richest-bitcoin-addresses.html (https://bitinfocharts.com/top-100-richest-bitcoin-addresses.html) But yeah. many have tried and noticed bitcoin is more secure than they thought. Would be interesting to know what is your angle of attack :) When reading your post I assumed you are just interested in the blockchain and exploring it out of interest. Because I have been doing the same. there are some quite interesting addresses. Examples here: http://www.theopenledger.com/9-most-famous-bitcoin-addresses/ (http://www.theopenledger.com/9-most-famous-bitcoin-addresses/) Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 09, 2017, 02:49:36 AM Waste of time, what is the point? It would take you longer or about the same amount of time to steal coins this way than it would to mine Bitcoins using the same equipment. People have tried this time and time again and the results are the same, they give up because it is a fruitless pursuit. There is always someone that thinks they know better than the system and they fail in the end, so please try again. what makes you think, my method is same as others., remember everyone is unique :PSo you admit you are trying to steal bitcoins? Good luck with that. I don't know, why you need to be able to parse the blockchain yourself though. Why not explore ready made lists of bitcoin addresses. https://bitinfocharts.com/top-100-richest-bitcoin-addresses.html (https://bitinfocharts.com/top-100-richest-bitcoin-addresses.html) But yeah. many have tried and noticed bitcoin is more secure than they thought. Would be interesting to know what is your angle of attack :) When reading your post I assumed you are just interested in the blockchain and exploring it out of interest. Because I have been doing the same. there are some quite interesting addresses. Examples here: http://www.theopenledger.com/9-most-famous-bitcoin-addresses/ (http://www.theopenledger.com/9-most-famous-bitcoin-addresses/) i m more of like whitehat . i want make sure, if blockchain is secure enough, so that i can invest some big chunk of money in bitcoins. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: amaclin1 on October 09, 2017, 04:56:57 AM i want make sure, if blockchain is secure enough You do not have skills and knowledge for such checks ans assumptions ;DTitle: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 09, 2017, 05:14:54 AM i want make sure, if blockchain is secure enough You do not have skills and knowledge for such checks ans assumptions ;Di know, not yet, but i am trying/willing to learn. edit: 12th oct 2017 i have used blockaparser on 50% blocks. which gave me 4 gb allbalnce.txt file., i used 7zip to zip it., if anyone is intersted here it is., https://transfer.sh/DLIpD/blockparser-allBalances.txt.7z ill try to parse the complete block when i get free time., and try to keep this thread updated. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: hamdi on October 19, 2017, 11:51:00 PM anybody had success above segwit blocks?
Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on October 20, 2017, 02:33:59 AM anybody had success above segwit blocks? using blockparsertheoritically yes, practically no remove all blocks after which segit is implemeted., remove bitcoind install bitcoin-core version bitcoin-core-0.11.2 start bitcoind run blockparser again else remove all blocks after which segit is implemeted., remove bitcoind install bitcoin-core version bitcoin-core-0.11.2 start bitcoind with resync run blockparser again edit: practically no means i have not tried it yet., but its the solution/correct way to do it., thats what i have been told. ill try it this week. good luck Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: hamdi on October 20, 2017, 08:16:18 AM thanks a lot for replying!!!
Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: hamdi on October 20, 2017, 10:10:47 AM probably this python software
https://github.com/chainside/btcpy is any help! Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on December 10, 2017, 12:22:43 PM its a old one, but if you still want it here is it.
Code: https://transfer.sh/jfQfE/balances.zip Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: btctousd81 on March 06, 2018, 12:55:27 AM Can you reupload allbalances.txt ? old link is not working. Thanks. ill try to upload tonight. Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: starmyc on March 14, 2018, 07:01:48 AM Can you reupload allbalances.txt ? old link is not working. Thanks. ill try to upload tonight. I've generated a dump for all balances on the other post: https://bitcointalk.org/index.php?topic=267618.msg32209481#msg32209481 (https://bitcointalk.org/index.php?topic=267618.msg32209481#msg32209481). Did you take a look at it ? If so, what do you think ? Title: Re: How to read/parse blockchain and get bitcoin addresses having balance. Post by: coder0x15 on July 21, 2018, 10:38:02 PM Try this https://github.com/normanvolt/blockchain-parser (https://github.com/normanvolt/blockchain-parser)
No installation, no dependencies needed. Just pure Python and the script by the link. |