n4ru (OP)
|
|
August 03, 2013, 09:19:00 PM |
|
Is there a way to find/export all addresses with a balance above a certain number to CSV or other file?
|
|
|
|
Remember remember the 5th of November
Legendary
Offline
Activity: 1862
Merit: 1011
Reverse engineer from time to time
|
|
August 03, 2013, 10:40:51 PM |
|
Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database.
|
BTC:1AiCRMxgf1ptVQwx6hDuKMu4f7F27QmJC2
|
|
|
battani
Newbie
Offline
Activity: 25
Merit: 0
|
|
August 07, 2013, 03:41:08 PM |
|
Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database.
Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery
|
|
|
|
Remember remember the 5th of November
Legendary
Offline
Activity: 1862
Merit: 1011
Reverse engineer from time to time
|
|
August 07, 2013, 04:18:53 PM |
|
I would recommend ABE, but with it, if you start importing from block 0, it might take a month or two to fully import the blockchain, unless of course you have an SSD and fast RAM.
|
BTC:1AiCRMxgf1ptVQwx6hDuKMu4f7F27QmJC2
|
|
|
w00dy
Member
Offline
Activity: 96
Merit: 10
|
|
August 07, 2013, 07:51:17 PM |
|
in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse
|
|
|
|
n4ru (OP)
|
|
August 08, 2013, 08:20:37 AM |
|
in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse Bravo, thank you very much!
|
|
|
|
Dabs
Legendary
Offline
Activity: 3416
Merit: 1912
The Concierge of Crypto
|
|
August 09, 2013, 12:23:02 AM |
|
Hi,
How large is the resulting file? Can someone be kind enough to post the top 1000 or the top 10,000 addresses as of a certain date? That would be interesting information.
|
|
|
|
w00dy
Member
Offline
Activity: 96
Merit: 10
|
|
August 09, 2013, 06:31:16 AM |
|
info: 251073 blocks, 16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta = 0.00s ,
info: found 1838168 addresses with non zero balance
-------------------------
The result is a 2.7GB Text file.
sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection.
|
|
|
|
n4ru (OP)
|
|
August 09, 2013, 06:40:04 AM |
|
info: 251073 blocks, 16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta = 0.00s ,
info: found 1838168 addresses with non zero balance
-------------------------
The result is a 2.7GB Text file.
sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection.
Can you upload just the addresses alone? I'll tip a couple bitcents.
|
|
|
|
w00dy
Member
Offline
Activity: 96
Merit: 10
|
|
August 09, 2013, 12:44:34 PM |
|
The result is a lot smaller block height was 251073 at the run. All Adresses (WITH a balance! not all ever used ones). 1,8ish Million. Down to the last Satoshi https://mega.co.nz/#!90RxEIZC!cv5xVChAvF_u7aNwnvBHEEyq668AoUjpmFv0t-jWFKA Same list but with the balance for each Address https://mega.co.nz/#!8sR0QCyZ!aMsjDEJw8ulbqHQ_HgNSQBoZcqZdyyCzEgjGjgw3KYM both 46ish MB zipped, first one 61 MB, 2nd one 82 MB uncompressed. Please note, you need a real Editor on Windows to open them. Notepad++ for example. Notepad don't cut it here.
|
|
|
|
dserrano5
Legendary
Offline
Activity: 1974
Merit: 1029
|
|
August 09, 2013, 06:54:54 PM |
|
Thanks for these listings!
Interesting to see that only ~3% of all addresses have 50 BTC or more. 10% have 1 BTC or more. The median balance is 0.0002 BTC. 44% of all addresses have what today is considered dust (ie less than 5430 satoshis). If only we could map this to (anonymous) individual people…
|
|
|
|
w00dy
Member
Offline
Activity: 96
Merit: 10
|
|
August 11, 2013, 12:20:42 PM |
|
44% of all addresses have what today is considered dust (ie less than 5430 satoshis).
|
|
|
|
w00dy
Member
Offline
Activity: 96
Merit: 10
|
|
January 03, 2014, 02:23:33 PM |
|
i got a PM asking about a fresh set of lists. Here we go: All Adresses (WITH a balance! not all ever used ones). 2,4ish Million. Down to the last Satoshi https://mega.co.nz/#!59QG0JCK!SHce3leeLBJTl4Dwk3tnpF9NLFEqh4GNHlnd2M1CIkM Same list but with the balance for each Address https://mega.co.nz/#!c85TQAgZ!Vibawlxa0spSkbo_HEEdf17O790nyxZefPfjSkryVrM
|
|
|
|
jratcliff63367
Member
Offline
Activity: 82
Merit: 10
|
|
January 08, 2014, 09:36:28 PM |
|
If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharingRun blockchain.exe passing in the command line argument of wherever the blk? ?.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html
|
|
|
|
cp1
|
|
January 08, 2014, 09:39:31 PM |
|
I'm curious as to what % of possible addresses have been used?
|
|
|
|
jratcliff63367
Member
Offline
Activity: 82
Merit: 10
|
|
January 08, 2014, 10:04:05 PM |
|
What do you mean? The percent of all possible addresses which have been used to date is probably something like 0.00000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 01%
|
|
|
|
cp1
|
|
January 08, 2014, 10:08:12 PM |
|
Of course it's small, I'm just curious. There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses? Do we have 1/1e40 of addresses used, or is it smaller?
|
|
|
|
Aleš Janda
Newbie
Offline
Activity: 9
Merit: 2
|
|
January 18, 2014, 08:49:45 PM |
|
Of course it's small, I'm just curious. There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses? Do we have 1/1e40 of addresses used, or is it smaller?
Definitelly smaller. We have 2e7 used addressed now, so total space is ~ 5e40 times larger.
|
|
|
|
Enkel
Member
Offline
Activity: 122
Merit: 20
|
|
January 19, 2014, 04:25:38 AM |
|
If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharingRun blockchain.exe passing in the command line argument of wherever the blk? ?.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.htmlThanks for posting this! (I'm mostly posting so I can find this again in the future for a potential project). BUT, From the last link (the blog post): 2,023,005 bitcoins reside in addresses which have been untouched in over three years. It makes me sad to think of all those abandoned BTC... I wish I could call them into my wallet and give them a nice home where they will be loved and cherished.
|
|
|
|
micax1
|
|
June 13, 2014, 07:01:31 PM |
|
If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharingRun blockchain.exe passing in the command line argument of wherever the blk? ?.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.htmlafter "process" - utility simple gathers final statistics and quits...
|
|
|
|
|