Bitcoin Forum
April 21, 2018, 06:37:19 AM *
News: Latest stable version of Bitcoin Core: 0.16.0  [Torrent]. (New!)
 
   Home   Help Search Donate Login Register  
Pages: « 1 2 3 4 5 6 7 8 9 10 [11] 12 13 »  All
  Print  
Author Topic: Get list of all addresses with a balance over x?  (Read 38970 times)
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 06, 2018, 09:01:29 AM
 #201

Thanks for explanation.
Another one is ..
there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean?
T.

The 0e0 thing is something I didn't remove from output, and this is the obfuscation key of my database, and not an address. You can ignore it.

The bc1 addresses are bech32 addresses, introduced last year for segwit transactions. They are used in P2WPKH & P2WSH transactions.

Cheers.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
1524292639
Hero Member
*
Offline Offline

Posts: 1524292639

View Profile Personal Message (Offline)

Ignore
1524292639
Reply with quote  #2

1524292639
Report to moderator
The block chain is the main innovation of Bitcoin. It is the first distributed timestamping system.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1524292639
Hero Member
*
Offline Offline

Posts: 1524292639

View Profile Personal Message (Offline)

Ignore
1524292639
Reply with quote  #2

1524292639
Report to moderator
SoliDCoiNs
Jr. Member
*
Offline Offline

Activity: 109
Merit: 1


View Profile
March 07, 2018, 01:47:29 PM
 #202

Maybe someone has already done this and would like to share their results?
I think all of us would appreciate the effort!
Thanks!
erajaykumarrana
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
March 13, 2018, 11:26:04 AM
 #203

I've generated a new dump for all balances as of today.

Enjoy: https://transfer.sh/12aVfO/balances_20180304.out.gz

Cheers.


friend can you tell me how you generated this list,  I have to generate it for dash coin....

I have seen your code on github... how can i compile it in visual studio 2017 on windows
do you parse chain state directory...
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 14, 2018, 06:17:37 AM
 #204

friend can you tell me how you generated this list,  I have to generate it for dash coin....

I have seen your code on github... how can i compile it in visual studio 2017 on windows
do you parse chain state directory...

I've used this tool https://github.com/mycroft/chainstate I worked on as you know, using Bitcoin Core 0.15.1's updated chainstate, on Linux.

Unfortunately, I've a bad news for you... First, I've no knowledge in Visual Studio and I'm pretty much sure you'll need to update the code a lot to make it compile.
The good news is that dashcore also merged the new chainstate db format (https://github.com/bitcoin/bitcoin/pull/10195) I'm parsing, so it would be possible that this tool works correctly against dashcore!

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 16, 2018, 10:41:53 AM
 #205

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
bigman3912
Newbie
*
Offline Offline

Activity: 12
Merit: 0


View Profile
March 16, 2018, 10:49:21 AM
 #206

Thank you very much. so, i guess your chainstate parser still works?
btw, every balance is matter, even it equals 1 satoshi. Smiley file is not too big. it easily opens on a good pc.
LeonsBTT
Newbie
*
Offline Offline

Activity: 14
Merit: 0


View Profile WWW
March 16, 2018, 02:15:10 PM
 #207

What if a person has more than 1 account?

I mean what is the value of these files?

https://www.leons.io/
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 16, 2018, 02:17:13 PM
 #208

Thank you very much. so, i guess your chainstate parser still works?

Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort.

btw, every balance is matter, even it equals 1 satoshi. Smiley file is not too big. it easily opens on a good pc.

This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this.

Cheers.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 16, 2018, 02:19:41 PM
 #209

What if a person has more than 1 account?

I mean what is the value of these files?

Nobody can regroup all addresses of a single wallet.

If you don't value this information, you're free to not download it. Smiley

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
LeonsBTT
Newbie
*
Offline Offline

Activity: 14
Merit: 0


View Profile WWW
March 16, 2018, 02:23:40 PM
 #210

What if a person has more than 1 account?

I mean what is the value of these files?

Nobody can regroup all addresses of a single wallet.

If you don't value this information, you're free to not download it. Smiley

What I mean is that if I am a whale that hold 10% of total bitcoins for me it is very easy to have different accounts, adresses etc and divide my coins between them. In other words, What conclusions do you want to get using this data? Do you think that they will be reliable?

https://www.leons.io/
bigman3912
Newbie
*
Offline Offline

Activity: 12
Merit: 0


View Profile
March 16, 2018, 02:40:43 PM
 #211

Thank you very much. so, i guess your chainstate parser still works?

Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort.

btw, every balance is matter, even it equals 1 satoshi. Smiley file is not too big. it easily opens on a good pc.

This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this.

Cheers.

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 16, 2018, 02:58:41 PM
 #212

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
bigman3912
Newbie
*
Offline Offline

Activity: 12
Merit: 0


View Profile
March 16, 2018, 03:02:30 PM
 #213

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).

Understood. Will try it on my dual xeon server.
dxlmz01
Newbie
*
Offline Offline

Activity: 7
Merit: 0


View Profile
March 16, 2018, 08:04:11 PM
 #214

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

Thanks alot, I appreciate all the effort you're putting into this thread


can i ask for a favor ? if its not too much to ask, of course ...

I need a dump of addresses with balances until block #337000, not further.
can you find some spare time in your schedule to provide that ? I will be very thankful.
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 16, 2018, 09:32:02 PM
 #215

New dump for all bitcoin balances, as of today: balances.out.gz

I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets.

Have a nice day !

Thanks alot, I appreciate all the effort you're putting into this thread


can i ask for a favor ? if its not too much to ask, of course ...

I need a dump of addresses with balances until block #337000, not further.
can you find some spare time in your schedule to provide that ? I will be very thankful.

I can do this, but it would require a little work. Can you send me a PM about this (can't send you one, you're blocking messages from newbies like me Wink ) ?

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
dinhbiplus
Jr. Member
*
Offline Offline

Activity: 42
Merit: 1

Fake Everything


View Profile WWW
March 18, 2018, 09:03:36 PM
 #216

Can't you just sort the output?

Best Alexa & Hypestat Service
MELYWEB (https://melyweb.net)
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 18, 2018, 09:19:48 PM
 #217

Can't you just sort the output?

I think I could do this. Mind to submit a patch ?

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
erajaykumarrana
Newbie
*
Offline Offline

Activity: 2
Merit: 0


View Profile
March 19, 2018, 09:42:54 AM
 #218

A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour.

Can you share with me your chainstate parser? Wanna try it. Thanks.

The source code is opensource, on github: https://github.com/mycroft/chainstate
It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory
The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions.

As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin).
Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all).


I think I could do this. Mind to submit a patch ?
[/quote]


frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux....
I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make....
can you please PM me(I cant send you message as u block newbie....)....

Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 19, 2018, 09:57:19 AM
 #219

frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux....
I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make....
can you please PM me(I cant send you message as u block newbie....)....

Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses....

I've sent you a PM with my email address so you can communicate privately, if you need to.

Which coins will you this information ?

The chainstate software is tied to Bitcoin Core (0.15+)'s chainstate format. If dash (or any other coin) is not using the same format, it won't work. Note that Bitcoin Core implemented this format in April last year, so it is most likely this software won't work.

I could take a look at DASH, it would require me a few days however.

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
starmyc
Member
**
Online Online

Activity: 84
Merit: 43

Software engineer


View Profile WWW
March 19, 2018, 11:49:54 AM
 #220

I could take a look at DASH, it would require me a few days however.

Ok, I was able to extract all current balances for Dash.
Have fun with this: https://transfer.sh/109sSU/balances.dash.out.gz

Software engineer for hire: API, Fullstack dev, Altcoin help & support, ETH contracts, sysadmin... PM me if you need help!
Tip me: 3An9ddmuGr7DsvdUUFJshCidq97E3Re8Eg
Pages: « 1 2 3 4 5 6 7 8 9 10 [11] 12 13 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!