Get list of all addresses with a balance over x?

[starmyc]

Thanks for explanation.
Another one is ..
there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean?
T.

The 0e0 thing is something I didn't remove from output, and this is the obfuscation key of my database, and not an address. You can ignore it.

The bc1 addresses are bech32 addresses, introduced last year for segwit transactions. They are used in P2WPKH & P2WSH transactions.

Cheers.

[SoliDCoiNs]

Maybe someone has already done this and would like to share their results?
I think all of us would appreciate the effort!
Thanks!

[erajaykumarrana]

I've generated a new dump for all balances as of today.

Enjoy: https://transfer.sh/12aVfO/balances_20180304.out.gz

Cheers.

friend can you tell me how you generated this list,  I have to generate it for dash coin....

I have seen your code on github... how can i compile it in visual studio 2017 on windows
do you parse chain state directory...

[starmyc]

friend can you tell me how you generated this list,  I have to generate it for dash coin....

I have seen your code on github... how can i compile it in visual studio 2017 on windows
do you parse chain state directory...

I've used this tool https://github.com/mycroft/chainstate I worked on as you know, using Bitcoin Core 0.15.1's updated chainstate, on Linux.

Unfortunately, I've a bad news for you... First, I've no knowledge in Visual Studio and I'm pretty much sure you'll need to update the code a lot to make it compile.
The good news is that dashcore also merged the new chainstate db format (https://github.com/bitcoin/bitcoin/pull/10195) I'm parsing, so it would be possible that this tool works correctly against dashcore!

[starmyc]

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

[bigman3912]

Thank you very much. so, i guess your chainstate parser still works?
btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc.

[LeonsBTT]

What if a person has more than 1 account?

I mean what is the value of these files?

[starmyc]

Thank you very much. so, i guess your chainstate parser still works?

Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort.

btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc.

This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this.

Cheers.

[starmyc]

What if a person has more than 1 account?

I mean what is the value of these files?

Nobody can regroup all addresses of a single wallet.

If you don't value this information, you're free to not download it.

[LeonsBTT]

What if a person has more than 1 account?

I mean what is the value of these files?

Nobody can regroup all addresses of a single wallet.

If you don't value this information, you're free to not download it.

What I mean is that if I am a whale that hold 10% of total bitcoins for me it is very easy to have different accounts, adresses etc and divide my coins between them. In other words, What conclusions do you want to get using this data? Do you think that they will be reliable?

[bigman3912]

Thank you very much. so, i guess your chainstate parser still works?

Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort.

btw, every balance is matter, even it equals 1 satoshi. file is not too big. it easily opens on a good pc.

This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this.

Cheers.

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

[starmyc]

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).

[bigman3912]

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).

Understood. Will try it on my dual xeon server.

[dxlmz01]

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

Thanks alot, I appreciate all the effort you're putting into this thread


can i ask for a favor ? if its not too much to ask, of course ...

I need a dump of addresses with balances until block #337000, not further.
can you find some spare time in your schedule to provide that ? I will be very thankful.

[starmyc]

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

Thanks alot, I appreciate all the effort you're putting into this thread


can i ask for a favor ? if its not too much to ask, of course ...

I need a dump of addresses with balances until block #337000, not further.
can you find some spare time in your schedule to provide that ? I will be very thankful.

I can do this, but it would require a little work. Can you send me a PM about this (can't send you one, you're blocking messages from newbies like me ) ?

[dinhbiplus]

Can't you just sort the output?

[starmyc]

Can't you just sort the output?

I think I could do this. Mind to submit a patch ?

[erajaykumarrana]

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).

I think I could do this. Mind to submit a patch ?
[/quote]


frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux....
I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make....
can you please PM me(I cant send you message as u block newbie....)....

Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....

[starmyc]

frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux....
I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make....
can you please PM me(I cant send you message as u block newbie....)....

Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....

I've sent you a PM with my email address so you can communicate privately, if you need to.

Which coins will you this information ?

The chainstate software is tied to Bitcoin Core (0.15+)'s chainstate format. If dash (or any other coin) is not using the same format, it won't work. Note that Bitcoin Core implemented this format in April last year, so it is most likely this software won't work.

I could take a look at DASH, it would require me a few days however.

[starmyc]

I could take a look at DASH, it would require me a few days however.

Ok, I was able to extract all current balances for Dash.
Have fun with this: https://transfer.sh/109sSU/balances.dash.out.gz