Bitcoin Forum
November 13, 2024, 02:08:56 AM *
News: Check out the artwork 1Dq created to commemorate this forum's 15th anniversary
 
   Home   Help Search Login Register More  
Pages: [1] 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 »  All
  Print  
Author Topic: Get list of all addresses with a balance over x?  (Read 43389 times)
n4ru (OP)
Sr. Member
****
Offline Offline

Activity: 350
Merit: 250



View Profile
August 03, 2013, 09:19:00 PM
 #1

Is there a way to find/export all addresses with a balance above a certain number to CSV or other file?
Remember remember the 5th of November
Legendary
*
Offline Offline

Activity: 1862
Merit: 1011

Reverse engineer from time to time


View Profile
August 03, 2013, 10:40:51 PM
 #2

Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database.

BTC:1AiCRMxgf1ptVQwx6hDuKMu4f7F27QmJC2
battani
Newbie
*
Offline Offline

Activity: 25
Merit: 0



View Profile
August 07, 2013, 03:41:08 PM
 #3

Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database.

Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery
Remember remember the 5th of November
Legendary
*
Offline Offline

Activity: 1862
Merit: 1011

Reverse engineer from time to time


View Profile
August 07, 2013, 04:18:53 PM
 #4

I would recommend ABE, but with it, if you start importing from block 0, it might take a month or two to fully import the blockchain, unless of course you have an SSD and fast RAM.

BTC:1AiCRMxgf1ptVQwx6hDuKMu4f7F27QmJC2
w00dy
Member
**
Offline Offline

Activity: 96
Merit: 10


View Profile
August 07, 2013, 07:51:17 PM
 #5

in short:

- get a Linux Box/VM with >=8GB RAM
- download blockparser
- compile it
- run "./parser allBalances  -w 250000 >allBalances.txt"

the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM)

now you have a list of the top 250.000 adresses sorted by BTC amount.

add some sed/awk/cut magic to make a csv and you are done.


not as easy for the avg windows joe but not that hard either...


quick'n'dirty Wink

Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse
n4ru (OP)
Sr. Member
****
Offline Offline

Activity: 350
Merit: 250



View Profile
August 08, 2013, 08:20:37 AM
 #6

in short:

- get a Linux Box/VM with >=8GB RAM
- download blockparser
- compile it
- run "./parser allBalances  -w 250000 >allBalances.txt"

the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM)

now you have a list of the top 250.000 adresses sorted by BTC amount.

add some sed/awk/cut magic to make a csv and you are done.


not as easy for the avg windows joe but not that hard either...


quick'n'dirty Wink

Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse

Bravo, thank you very much!
Dabs
Legendary
*
Offline Offline

Activity: 3416
Merit: 1912


The Concierge of Crypto


View Profile
August 09, 2013, 12:23:02 AM
 #7

Hi,

How large is the resulting file? Can someone be kind enough to post the top 1000 or the top 10,000 addresses as of a certain date? That would be interesting information.

w00dy
Member
**
Offline Offline

Activity: 96
Merit: 10


View Profile
August 09, 2013, 06:31:16 AM
 #8

info:   251073 blocks,   16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta =  0.00s ,

info: found 1838168 addresses with non zero balance

-------------------------

The result is a 2.7GB Text file.

sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection.
n4ru (OP)
Sr. Member
****
Offline Offline

Activity: 350
Merit: 250



View Profile
August 09, 2013, 06:40:04 AM
 #9

info:   251073 blocks,   16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta =  0.00s ,

info: found 1838168 addresses with non zero balance

-------------------------

The result is a 2.7GB Text file.

sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection.
Can you upload just the addresses alone? I'll tip a couple bitcents.
w00dy
Member
**
Offline Offline

Activity: 96
Merit: 10


View Profile
August 09, 2013, 12:44:34 PM
 #10

The result is a lot smaller  Smiley

block height was 251073 at the run.

All Adresses (WITH a balance! not all ever used ones). 1,8ish Million. Down to the last Satoshi
Code:
https://mega.co.nz/#!90RxEIZC!cv5xVChAvF_u7aNwnvBHEEyq668AoUjpmFv0t-jWFKA

Same list but with the balance for each Address
Code:
https://mega.co.nz/#!8sR0QCyZ!aMsjDEJw8ulbqHQ_HgNSQBoZcqZdyyCzEgjGjgw3KYM


both 46ish MB zipped, first one 61 MB, 2nd one 82 MB uncompressed.

Please note, you need a real Editor on Windows to open them. Notepad++ for example. Notepad don't cut it here.
dserrano5
Legendary
*
Offline Offline

Activity: 1974
Merit: 1029



View Profile
August 09, 2013, 06:54:54 PM
 #11

Thanks for these listings!

Interesting to see that only ~3% of all addresses have 50 BTC or more. 10% have 1 BTC or more. The median balance is 0.0002 BTC. 44% of all addresses have what today is considered dust (ie less than 5430 satoshis). If only we could map this to (anonymous) individual people…
w00dy
Member
**
Offline Offline

Activity: 96
Merit: 10


View Profile
August 11, 2013, 12:20:42 PM
 #12

44% of all addresses have what today is considered dust (ie less than 5430 satoshis).

 Shocked
w00dy
Member
**
Offline Offline

Activity: 96
Merit: 10


View Profile
January 03, 2014, 02:23:33 PM
 #13

i got a PM asking about a fresh set of lists.

Here we go:

All Adresses (WITH a balance! not all ever used ones). 2,4ish Million. Down to the last Satoshi
Code:
https://mega.co.nz/#!59QG0JCK!SHce3leeLBJTl4Dwk3tnpF9NLFEqh4GNHlnd2M1CIkM

Same list but with the balance for each Address

Code:
https://mega.co.nz/#!c85TQAgZ!Vibawlxa0spSkbo_HEEdf17O790nyxZefPfjSkryVrM

jratcliff63367
Member
**
Offline Offline

Activity: 82
Merit: 10


View Profile
January 08, 2014, 09:36:28 PM
 #14

If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app:

First, download an unzip the console app.

https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing

Run blockchain.exe passing in the command line argument of wherever the blk?Huh?.dat files are on your machine.

Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks

Once the program comes up, type the command: "scan" and hit enter.  This will scan all of the blockchain.

Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine!

Next, type "process" and hit enter.

When that is done you can decide the minimum balance addresses you want to know about.  Say you want all addresses with more than 1000 bitcoins.  Then type: "min_balance 1000" and hit enter.

Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100"

Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it.  However, doing queries against it once it has been parsed is immediate.

You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days.  So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year).

If somebody wants to build this for Ubuntu or Mac-OS that would be great too.

http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html
cp1
Hero Member
*****
Offline Offline

Activity: 616
Merit: 500


Stop using branwallets


View Profile
January 08, 2014, 09:39:31 PM
 #15

I'm curious as to what % of possible addresses have been used?

Guide to armory offline install on USB key:  https://bitcointalk.org/index.php?topic=241730.0
jratcliff63367
Member
**
Offline Offline

Activity: 82
Merit: 10


View Profile
January 08, 2014, 10:04:05 PM
 #16

What do you mean?  The percent of all possible addresses which have been used to date is probably something like 0.00000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 01%
cp1
Hero Member
*****
Offline Offline

Activity: 616
Merit: 500


Stop using branwallets


View Profile
January 08, 2014, 10:08:12 PM
 #17

Of course it's small, I'm just curious.  There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses?  Do we have 1/1e40 of addresses used, or is it smaller?

Guide to armory offline install on USB key:  https://bitcointalk.org/index.php?topic=241730.0
Aleš Janda
Newbie
*
Offline Offline

Activity: 9
Merit: 2



View Profile WWW
January 18, 2014, 08:49:45 PM
 #18

Of course it's small, I'm just curious.  There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses?  Do we have 1/1e40 of addresses used, or is it smaller?

Definitelly smaller. We have 2e7 used addressed now, so total space is ~ 5e40 times larger.
Enkel
Member
**
Offline Offline

Activity: 122
Merit: 20



View Profile
January 19, 2014, 04:25:38 AM
 #19

If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app:

First, download an unzip the console app.

https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing

Run blockchain.exe passing in the command line argument of wherever the blk?Huh?.dat files are on your machine.

Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks

Once the program comes up, type the command: "scan" and hit enter.  This will scan all of the blockchain.

Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine!

Next, type "process" and hit enter.

When that is done you can decide the minimum balance addresses you want to know about.  Say you want all addresses with more than 1000 bitcoins.  Then type: "min_balance 1000" and hit enter.

Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100"

Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it.  However, doing queries against it once it has been parsed is immediate.

You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days.  So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year).

If somebody wants to build this for Ubuntu or Mac-OS that would be great too.

http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html

Thanks for posting this! (I'm mostly posting so I can find this again in the future for a potential project).

BUT, From the last link (the blog post):

Quote
2,023,005 bitcoins reside in addresses which have been untouched in over three years.

It makes me sad to think of all those abandoned BTC... I wish I could call them into my wallet and give them a nice home where they will be loved and cherished.

micax1
Hero Member
*****
Offline Offline

Activity: 708
Merit: 502


View Profile
June 13, 2014, 07:01:31 PM
 #20

If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app:

First, download an unzip the console app.

https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing

Run blockchain.exe passing in the command line argument of wherever the blk?Huh?.dat files are on your machine.

Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks

Once the program comes up, type the command: "scan" and hit enter.  This will scan all of the blockchain.

Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine!

Next, type "process" and hit enter.

When that is done you can decide the minimum balance addresses you want to know about.  Say you want all addresses with more than 1000 bitcoins.  Then type: "min_balance 1000" and hit enter.

Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100"

Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it.  However, doing queries against it once it has been parsed is immediate.

You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days.  So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year).

If somebody wants to build this for Ubuntu or Mac-OS that would be great too.

http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html



after "process" - utility simple gathers final statistics and quits...
Pages: [1] 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 »  All
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!