starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 06, 2018, 09:01:29 AM |
|
Thanks for explanation. Another one is .. there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean? T.
The 0e0 thing is something I didn't remove from output, and this is the obfuscation key of my database, and not an address. You can ignore it. The bc1 addresses are bech32 addresses, introduced last year for segwit transactions. They are used in P2WPKH & P2WSH transactions. Cheers.
|
|
|
|
SoliDCoiNs
Jr. Member
Offline
Activity: 104
Merit: 1
|
|
March 07, 2018, 01:47:29 PM |
|
Maybe someone has already done this and would like to share their results? I think all of us would appreciate the effort! Thanks!
|
|
|
|
erajaykumarrana
Newbie
Offline
Activity: 2
Merit: 0
|
|
March 13, 2018, 11:26:04 AM Last edit: March 13, 2018, 11:37:25 AM by erajaykumarrana |
|
friend can you tell me how you generated this list, I have to generate it for dash coin.... I have seen your code on github... how can i compile it in visual studio 2017 on windows do you parse chain state directory...
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 14, 2018, 06:17:37 AM |
|
friend can you tell me how you generated this list, I have to generate it for dash coin....
I have seen your code on github... how can i compile it in visual studio 2017 on windows do you parse chain state directory...
I've used this tool https://github.com/mycroft/chainstate I worked on as you know, using Bitcoin Core 0.15.1's updated chainstate, on Linux. Unfortunately, I've a bad news for you... First, I've no knowledge in Visual Studio and I'm pretty much sure you'll need to update the code a lot to make it compile. The good news is that dashcore also merged the new chainstate db format ( https://github.com/bitcoin/bitcoin/pull/10195) I'm parsing, so it would be possible that this tool works correctly against dashcore!
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 16, 2018, 10:41:53 AM |
|
New dump for all bitcoin balances, as of today: balances.out.gzI think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day !
|
|
|
|
bigman3912
Newbie
Offline
Activity: 12
Merit: 0
|
|
March 16, 2018, 10:49:21 AM |
|
Thank you very much. so, i guess your chainstate parser still works? btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc.
|
|
|
|
LeonsBTT
Newbie
Offline
Activity: 14
Merit: 0
|
|
March 16, 2018, 02:15:10 PM |
|
What if a person has more than 1 account?
I mean what is the value of these files?
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 16, 2018, 02:17:13 PM |
|
Thank you very much. so, i guess your chainstate parser still works?
Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort. btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc. This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this. Cheers.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 16, 2018, 02:19:41 PM |
|
What if a person has more than 1 account?
I mean what is the value of these files?
Nobody can regroup all addresses of a single wallet. If you don't value this information, you're free to not download it.
|
|
|
|
LeonsBTT
Newbie
Offline
Activity: 14
Merit: 0
|
|
March 16, 2018, 02:23:40 PM |
|
What if a person has more than 1 account?
I mean what is the value of these files?
Nobody can regroup all addresses of a single wallet. If you don't value this information, you're free to not download it. What I mean is that if I am a whale that hold 10% of total bitcoins for me it is very easy to have different accounts, adresses etc and divide my coins between them. In other words, What conclusions do you want to get using this data? Do you think that they will be reliable?
|
|
|
|
bigman3912
Newbie
Offline
Activity: 12
Merit: 0
|
|
March 16, 2018, 02:40:43 PM |
|
Thank you very much. so, i guess your chainstate parser still works?
Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort. btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc. This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this. Cheers. A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour. Can you share with me your chainstate parser? Wanna try it. Thanks.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 16, 2018, 02:58:41 PM |
|
A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.
Can you share with me your chainstate parser? Wanna try it. Thanks.
The source code is opensource, on github: https://github.com/mycroft/chainstateIt doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectoryThe chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).
|
|
|
|
bigman3912
Newbie
Offline
Activity: 12
Merit: 0
|
|
March 16, 2018, 03:02:30 PM |
|
A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.
Can you share with me your chainstate parser? Wanna try it. Thanks.
The source code is opensource, on github: https://github.com/mycroft/chainstateIt doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectoryThe chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all). Understood. Will try it on my dual xeon server.
|
|
|
|
dxlmz01
Newbie
Offline
Activity: 7
Merit: 0
|
|
March 16, 2018, 08:04:11 PM |
|
New dump for all bitcoin balances, as of today: balances.out.gzI think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day ! Thanks alot, I appreciate all the effort you're putting into this thread can i ask for a favor ? if its not too much to ask, of course ... I need a dump of addresses with balances until block #337000, not further. can you find some spare time in your schedule to provide that ? I will be very thankful.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 16, 2018, 09:32:02 PM |
|
New dump for all bitcoin balances, as of today: balances.out.gzI think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day ! Thanks alot, I appreciate all the effort you're putting into this thread can i ask for a favor ? if its not too much to ask, of course ... I need a dump of addresses with balances until block #337000, not further. can you find some spare time in your schedule to provide that ? I will be very thankful. I can do this, but it would require a little work. Can you send me a PM about this (can't send you one, you're blocking messages from newbies like me ) ?
|
|
|
|
dinhbiplus
Jr. Member
Offline
Activity: 42
Merit: 1
|
|
March 18, 2018, 09:03:36 PM |
|
Can't you just sort the output?
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 18, 2018, 09:19:48 PM |
|
Can't you just sort the output?
I think I could do this. Mind to submit a patch ?
|
|
|
|
erajaykumarrana
Newbie
Offline
Activity: 2
Merit: 0
|
|
March 19, 2018, 09:42:54 AM |
|
A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.
Can you share with me your chainstate parser? Wanna try it. Thanks.
The source code is opensource, on github: https://github.com/mycroft/chainstateIt doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectoryThe chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all). I think I could do this. Mind to submit a patch ? [/quote] frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux.... I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make.... can you please PM me(I cant send you message as u block newbie....).... Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 19, 2018, 09:57:19 AM |
|
frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux.... I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make.... can you please PM me(I cant send you message as u block newbie....)....
Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....
I've sent you a PM with my email address so you can communicate privately, if you need to. Which coins will you this information ? The chainstate software is tied to Bitcoin Core (0.15+)'s chainstate format. If dash (or any other coin) is not using the same format, it won't work. Note that Bitcoin Core implemented this format in April last year, so it is most likely this software won't work. I could take a look at DASH, it would require me a few days however.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
March 19, 2018, 11:49:54 AM |
|
I could take a look at DASH, it would require me a few days however.
Ok, I was able to extract all current balances for Dash. Have fun with this: https://transfer.sh/109sSU/balances.dash.out.gz
|
|
|
|
|