|
Title: Get list of all addresses with a balance over x? Post by: n4ru on August 03, 2013, 09:19:00 PM Is there a way to find/export all addresses with a balance above a certain number to CSV or other file?
Title: Re: Get list of all addresses with a balance over x? Post by: Remember remember the 5th of November on August 03, 2013, 10:40:51 PM Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database.
Title: Re: Get list of all addresses with a balance over x? Post by: battani on August 07, 2013, 03:41:08 PM Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database. Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery Title: Re: Get list of all addresses with a balance over x? Post by: Remember remember the 5th of November on August 07, 2013, 04:18:53 PM I would recommend ABE, but with it, if you start importing from block 0, it might take a month or two to fully import the blockchain, unless of course you have an SSD and fast RAM.
Title: Re: Get list of all addresses with a balance over x? Post by: w00dy on August 07, 2013, 07:51:17 PM in short:
- get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty ;) Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse Title: Re: Get list of all addresses with a balance over x? Post by: n4ru on August 08, 2013, 08:20:37 AM in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty ;) Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse Bravo, thank you very much! Title: Re: Get list of all addresses with a balance over x? Post by: Dabs on August 09, 2013, 12:23:02 AM Hi,
How large is the resulting file? Can someone be kind enough to post the top 1000 or the top 10,000 addresses as of a certain date? That would be interesting information. Title: Re: Get list of all addresses with a balance over x? Post by: w00dy on August 09, 2013, 06:31:16 AM info: 251073 blocks, 16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta = 0.00s ,
info: found 1838168 addresses with non zero balance ------------------------- The result is a 2.7GB Text file. sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection. Title: Re: Get list of all addresses with a balance over x? Post by: n4ru on August 09, 2013, 06:40:04 AM info: 251073 blocks, 16.412 MegaAddrs , 100.00% , elapsed = 133.24s , eta = 0.00s , Can you upload just the addresses alone? I'll tip a couple bitcents.info: found 1838168 addresses with non zero balance ------------------------- The result is a 2.7GB Text file. sripped to balance + Adress only, it's 700ish MB, 55MB gzip compressed. I will upload the file later. right now i'm on a very slow 3g connection. Title: Re: Get list of all addresses with a balance over x? Post by: w00dy on August 09, 2013, 12:44:34 PM The result is a lot smaller :)
block height was 251073 at the run. All Adresses (WITH a balance! not all ever used ones). 1,8ish Million. Down to the last Satoshi Code: https://mega.co.nz/#!90RxEIZC!cv5xVChAvF_u7aNwnvBHEEyq668AoUjpmFv0t-jWFKA Same list but with the balance for each Address Code: https://mega.co.nz/#!8sR0QCyZ!aMsjDEJw8ulbqHQ_HgNSQBoZcqZdyyCzEgjGjgw3KYM both 46ish MB zipped, first one 61 MB, 2nd one 82 MB uncompressed. Please note, you need a real Editor on Windows to open them. Notepad++ for example. Notepad don't cut it here. Title: Re: Get list of all addresses with a balance over x? Post by: dserrano5 on August 09, 2013, 06:54:54 PM Thanks for these listings!
Interesting to see that only ~3% of all addresses have 50 BTC or more. 10% have 1 BTC or more. The median balance is 0.0002 BTC. 44% of all addresses have what today is considered dust (ie less than 5430 satoshis). If only we could map this to (anonymous) individual people… Title: Re: Get list of all addresses with a balance over x? Post by: w00dy on August 11, 2013, 12:20:42 PM 44% of all addresses have what today is considered dust (ie less than 5430 satoshis). :o Title: Re: Get list of all addresses with a balance over x? Post by: w00dy on January 03, 2014, 02:23:33 PM i got a PM asking about a fresh set of lists.
Here we go: All Adresses (WITH a balance! not all ever used ones). 2,4ish Million. Down to the last Satoshi Code: https://mega.co.nz/#!59QG0JCK!SHce3leeLBJTl4Dwk3tnpF9NLFEqh4GNHlnd2M1CIkM Same list but with the balance for each Address Code: https://mega.co.nz/#!c85TQAgZ!Vibawlxa0spSkbo_HEEdf17O790nyxZefPfjSkryVrM Title: Re: Get list of all addresses with a balance over x? Post by: jratcliff63367 on January 08, 2014, 09:36:28 PM If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app:
First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing (https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing) Run blockchain.exe passing in the command line argument of wherever the blk?????.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html (http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html) Title: Re: Get list of all addresses with a balance over x? Post by: cp1 on January 08, 2014, 09:39:31 PM I'm curious as to what % of possible addresses have been used?
Title: Re: Get list of all addresses with a balance over x? Post by: jratcliff63367 on January 08, 2014, 10:04:05 PM What do you mean? The percent of all possible addresses which have been used to date is probably something like 0.00000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 0000000000000000000000000000000000000000000000000000000000000000000000000000000 01%
Title: Re: Get list of all addresses with a balance over x? Post by: cp1 on January 08, 2014, 10:08:12 PM Of course it's small, I'm just curious. There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses? Do we have 1/1e40 of addresses used, or is it smaller?
Title: Re: Get list of all addresses with a balance over x? Post by: Aleš Janda on January 18, 2014, 08:49:45 PM Of course it's small, I'm just curious. There's what, 1e48 possible addresses, and something like 100e6 transactions, but how many of those were to unique addresses? Do we have 1/1e40 of addresses used, or is it smaller? Definitelly smaller. We have 2e7 used addressed now, so total space is ~ 5e40 times larger. Title: Re: Get list of all addresses with a balance over x? Post by: Enkel on January 19, 2014, 04:25:38 AM If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing (https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing) Run blockchain.exe passing in the command line argument of wherever the blk?????.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html (http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html) Thanks for posting this! (I'm mostly posting so I can find this again in the future for a potential project). BUT, From the last link (the blog post): Quote 2,023,005 bitcoins reside in addresses which have been untouched in over three years. It makes me sad to think of all those abandoned BTC... I wish I could call them into my wallet and give them a nice home where they will be loved and cherished. Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on June 13, 2014, 07:01:31 PM If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing (https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing) Run blockchain.exe passing in the command line argument of wherever the blk?????.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html (http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html) after "process" - utility simple gathers final statistics and quits... Title: Re: Get list of all addresses with a balance over x? Post by: Altoidnerd on June 16, 2014, 07:13:26 AM I use znort987/blockparser in ubtunu/debian
Code:
This does get ALL balances. Anyone know how to tweak this? Title: Re: Get list of all addresses with a balance over x? Post by: cp1 on June 16, 2014, 04:34:53 PM Can't you just sort the output?
Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on October 20, 2014, 05:37:57 PM in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty ;) Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse it seems that -w option is not working correctly - I always get output of all addresses ~ 8GB Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on October 20, 2014, 09:38:35 PM Title: Re: Get list of all addresses with a balance over x? Post by: cp1 on October 20, 2014, 09:40:05 PM Why not, I've got 16 GB RAM :) Title: Re: Get list of all addresses with a balance over x? Post by: teukon on October 21, 2014, 12:51:39 AM I'm curious as to what % of possible addresses have been used? I know this is an old question but I was bored. As of block 326 219 (2014-10-20 23:15:09) I see 50 627 736 distinct addresses in the blockchain (including those with a balance of zero). There are 2160 = 1 461 501 637 330 902 918 203 684 832 716 283 019 655 932 542 976 different possible addresses (minor assumption about RIPEMD-160 here). Thus, we've used 3.464*10-39% of all possible addresses (4.s.f). That's 0.000 000 000 000 000 000 000 000 000 000 000 000 003 464% (4.s.f). I'm willing to bet I've made an error or two here. Title: Re: Get list of all addresses with a balance over x? Post by: lyth0s on October 21, 2014, 07:09:18 AM Just sent a PM to W00dy to see if we can get an updated address/btc list. I'd like to see how my own collection compares with the rest of the bitcoin users :D
Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on October 27, 2014, 10:07:05 PM anybody has updated list?
Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on October 28, 2014, 11:42:03 AM If you have a 64bit windows machine and the entire blockchain on your hard drive you can use this console app: First, download an unzip the console app. https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing (https://drive.google.com/file/d/0BwdyTvSh6bUkazZLRk1CQkVsNXM/edit?usp=sharing) Run blockchain.exe passing in the command line argument of wherever the blk?????.dat files are on your machine. Example: blockchain.exe c:\Users\YourName\AppData\Roaming\Bitcoin\blocks Once the program comes up, type the command: "scan" and hit enter. This will scan all of the blockchain. Next, enable gathering address statistics by typing "statistics" and hitting enter. Warning you must have a lot of memory and swap available on your machine! Next, type "process" and hit enter. When that is done you can decide the minimum balance addresses you want to know about. Say you want all addresses with more than 1000 bitcoins. Then type: "min_balance 1000" and hit enter. Now, to get a report of the top 100 addresses with a balance over a thousand type: "top_balance 100" Scanning and processing the blockchain may take a long time on your machine (several minutes) the first time you run it. However, doing queries against it once it has been parsed is immediate. You can also report the oldest addresses by using the command 'oldest' and you can get stats for 'zombie' addresses by typing 'zombie' followed by the number of days. So, if you type 'zombie 365' it will report stats about how many addresses (higher than the min balance and older than one year). If somebody wants to build this for Ubuntu or Mac-OS that would be great too. http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html (http://codesuppository.blogspot.com/2014/01/a-command-line-interface-for-blockchain.html) seems like code stopped working because of too many inputs in blockchain?? got this error code on linux: Processed block #300000 of 327276 total. blockchain.out: BlockChain.cpp:2932: TransactionOutput* BitcoinTransactionFactory::getOutputs(uint32_t): Assertion `(mTotalOutputCount+count) < 100000000' failed. Aborted (core dumped) Title: Re: Get list of all addresses with a balance over x? Post by: micax1 on October 28, 2014, 01:24:39 PM anybody here with knowledge of C++
please recompile: https://code.google.com/p/blockchain/source/checkout Thank you! Title: Re: Get list of all addresses with a balance over x? Post by: sologap on March 29, 2015, 09:57:08 PM any one got updated list ? im trying to run https://github.com/znort987/blockparser but im getting : Segmentation Fault
Title: Re: Get list of all addresses with a balance over x? Post by: Har01d on March 31, 2015, 02:06:34 AM ×
Title: Re: Get list of all addresses with a balance over x? Post by: sologap on March 31, 2015, 10:27:12 AM Finally i got blockparser to work, anyone have this problem "Segmentation Fault" follow this to make a swap file: http://askubuntu.com/questions/178712/how-to-increase-swap-space
my box is 250 ssd, 16gb ram, 9GB Swap Also here is all addresses list without balance as of block # 350544 (the size is https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM (https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM) Tips: 1JJAN1ueth6r7UNai37jK5UR6esCL2SUxh Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on April 03, 2015, 11:13:44 AM Are you sure that list is not somehow corrupted? For me it stops at line 503 and after that it's only endless lines of 'X's
Does somebody have an intact recent list off all addresses that they could share? Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: sologap on April 03, 2015, 12:25:48 PM Are you sure that list is not somehow corrupted? For me it stops at line 503 and after that it's only endless lines of 'X's Does somebody have an intact recent list off all addresses that they could share? Thanks! oh, i actually couldn't check it because of the size :o, i might forgot something. ill look into it and upload again. sorry about that Edit: here is the full list with no problems https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM (https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM) Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on April 06, 2015, 03:09:56 PM The new one works, thanks a bunch!
Title: Re: Get list of all addresses with a balance over x? Post by: sotruxoid on April 12, 2015, 07:25:22 PM I want to create a database with all the non-empty addresses, but for one particular day only. Any ideas?
Title: Re: Get list of all addresses with a balance over x? Post by: Har01d on April 12, 2015, 11:09:52 PM sotruxoid, look at my offer in the post #32: https://bitcointalk.org/index.php?topic=267618.msg10936300#msg10936300
There is no problem to make a snapshot for the specific day. For example, as for January 13, 2009 0:00 UTC, the list of addresses with the according balances would be the following: Code: 1CYG7y3fukVLdobqgUtbknwWKUZ5p1HVmV;50.00000000 For example take a look at https://blockchain.info/address/1ByLSV2gLRcuqUmfdYcpPQH8Npm8cccsFg It is in the list with the balance of 10 BTC, however its current balance is zero, because the money were spent at January, 14. If you want to develop your own solution, the only way to do it is to parse all the blocks which were mined before the specified day. Title: Re: Get list of all addresses with a balance over x? Post by: raydan on April 23, 2015, 10:38:45 AM Are you sure that list is not somehow corrupted? For me it stops at line 503 and after that it's only endless lines of 'X's Does somebody have an intact recent list off all addresses that they could share? Thanks! oh, i actually couldn't check it because of the size :o, i might forgot something. ill look into it and upload again. sorry about that Edit: here is the full list with no problems https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM (https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM) at line 3000004 it's only endless lines of 'X's Title: Re: Get list of all addresses with a balance over x? Post by: ChetnotAtkins on May 12, 2015, 07:42:46 PM Sologap's list is great, very interesting information, but already outdated
Does someone have a current list? Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: virtualx on May 13, 2015, 08:46:10 AM I use znort987/blockparser in ubtunu/debian Code:
This does get ALL balances. Anyone know how to tweak this? I think you can combine it with grep, this might do: Code: grep '50.00000000' manygigs.txt > result.txt If it does not work, the only method is to modify the code of the blockchain parser which should not be hard to do. Simply iterate all transactions in the blockchain and save those that meet the required conditions. :) Title: Re: Get list of all addresses with a balance over x? Post by: Bitcoin_BOy$ on May 14, 2015, 03:40:49 PM Hello , For me I'm a programmer and I can create functions in Php that check address balance
but if you are checking a hazard address that you generate from Python scripts ... I will say please don't waste your time (Already tested and hated my self after it ;D) . Bitcoin Boy. Title: Re: Get list of all addresses with a balance over x? Post by: ChetnotAtkins on May 18, 2015, 10:16:00 PM Does someone have a current list of all addresses with a Balance (over x) ?
Thanks Title: Re: Get list of all addresses with a balance over x? Post by: Bitcoin_BOy$ on May 18, 2015, 11:42:26 PM Over a year ago I actually started importing the blockchain and doing just that, but it requires the full blockchain imported into MySQL or your preferred database. Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery for captcha a time to time . But I would like to know for what will this be useful ??? I think you can just add your private keys to a wallet like Multi bit and get it ordered by balance and we are done ! Bitcoin Boy . Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on May 27, 2015, 09:06:45 AM I would also be interested in an up-to-date list of all addresses with balance. No sites I have found provide this service.
Could anybody please post the current list? Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on June 02, 2015, 10:25:34 AM bump
Anyone? Title: Re: Get list of all addresses with a balance over x? Post by: Muhammed Zakir on June 02, 2015, 03:34:38 PM Hope any of these helps you.
• https://bitcointalk.org/index.php?topic=959897.msg10500979#msg10500979 • https://github.com/znort987/blockparser • https://bitcointalk.org/index.php?topic=762445.0;all Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on June 02, 2015, 06:28:48 PM Thanks but unfortunately I don't have a local copy of the blockchain. That is why I was hoping a benevolent person like Sologap could post an up-to-date list of addresses with balance. I think such a list would be very useful to a lot of people and I wonder why no blockexplorer provides this service.
Title: Re: Get list of all addresses with a balance over x? Post by: fronti on June 02, 2015, 07:00:58 PM I think most people have now idea why such a list may be usefull.
What do you want for a service? type in a number of value and see on which position this is? Or what is your intention? in which format do you need the list? look this torrent: btc-address-balance-2015-06-02.txt.torrent Title: Re: Get list of all addresses with a balance over x? Post by: teukon on June 02, 2015, 11:44:50 PM I think most people have now idea why such a list may be usefull. What do you want for a service? type in a number of value and see on which position this is? Or what is your intention? in which format do you need the list? look this torrent: btc-address-balance-2015-06-02.txt.torrent My guess is curiosity about ranking. In which case http://ondn.net:800/search (http://ondn.net:800/search) would probably do the job. I wonder what other uses such a complete list would have. Title: Re: Get list of all addresses with a balance over x? Post by: tupelo on June 03, 2015, 07:25:29 PM I am interested in the distribution and want to make graphs for myself.
@fronti: I cannot find that torrent :( , could you check if it is still available? thanks! @teukon: thanks that site is also useful Title: Re: Get list of all addresses with a balance over x? Post by: vrzo on June 13, 2015, 07:11:59 PM What is the most recent number of bitcoin addresses with non-zero balance?
EDIT: I found it: 5.03M Title: Re: Get list of all addresses with a balance over x? Post by: ChetnotAtkins on June 15, 2015, 06:27:08 PM So does anybody have a current list of addresses with balance? I too could not find the torrent fronti was referring to
Title: Re: Get list of all addresses with a balance over x? Post by: maheshmahi on June 25, 2015, 02:59:22 PM But the resulting file may be upto 3 gb
Title: Re: Get list of all addresses with a balance over x? Post by: samsads on December 04, 2015, 01:28:17 PM Are you sure that list is not somehow corrupted? For me it stops at line 503 and after that it's only endless lines of 'X's Does somebody have an intact recent list off all addresses that they could share? Thanks! oh, i actually couldn't check it because of the size :o, i might forgot something. ill look into it and upload again. sorry about that Edit: here is the full list with no problems https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM (https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM) after 3000000 addresses its only XXXXXXXXXXXX ??? ??? Please can someone share the updated list. Will be very much thankful. Or atleast tell me a way to get all addresses without downloading the whole blockchain Plz help... I am new to this.. Title: Re: Get list of all addresses with a balance over x? Post by: mocacinno on December 04, 2015, 01:40:21 PM Are you sure that list is not somehow corrupted? For me it stops at line 503 and after that it's only endless lines of 'X's Does somebody have an intact recent list off all addresses that they could share? Thanks! oh, i actually couldn't check it because of the size :o, i might forgot something. ill look into it and upload again. sorry about that Edit: here is the full list with no problems https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM (https://mega.co.nz/#!0UpWCTxb!oIMkD8t4PK4iATuuj2TmMNhT4TXJn-pDcED1iyXBvAM) after 3000000 addresses its only XXXXXXXXXXXX ??? ??? Please can someone share the updated list. Will be very much thankful. Or atleast tell me a way to get all addresses without downloading the whole blockchain Plz help... I am new to this.. I can try to do this for you... But since it'll take a lot of time and recources, i'm not doing this for free ;) Title: Re: Get list of all addresses with a balance over x? Post by: amaclin on December 04, 2015, 01:53:14 PM But the resulting file may be upto 3 gb I have such list for regular (not p2sh addresses) with balancesThere are ~5700000 addresses there And the size of file is 288mb Title: Re: Get list of all addresses with a balance over x? Post by: samsads on December 04, 2015, 01:57:49 PM But the resulting file may be upto 3 gb I have such list for regular (not p2sh addresses) with balancesThere are ~5700000 addresses there And the size of file is 288mb compressed size 288mb?? will you plz share??? Title: Re: Get list of all addresses with a balance over x? Post by: amaclin on December 04, 2015, 02:04:20 PM compressed size 288mb?? uncompressed. not for freewill you plz share??? Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on February 20, 2016, 12:44:07 AM I have an new address list with balance:
If you like it, plz spend me some beer, cost me lot of brain and cpu time: 1F55vXEqYCq3pnLVe2JTJUXGGRmYgkKxW5 List is ordered by used time to block 398037. Format: "PublicKey;BalanceInSatoshi" Already a new: http://rs.keinbrot.com/balances399271.txt For futher updates: contact me ;) Title: Re: Get list of all addresses with a balance over x? Post by: manifold on March 28, 2016, 05:07:36 PM Already a new: Thanks so much!!!http://rs.keinbrot.com/balances399271.txt For futher updates: contact me ;) Title: Re: Get list of all addresses with a balance over x? Post by: gortva on May 23, 2016, 01:14:03 PM Do somebody have a fresh list?
Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on May 25, 2016, 01:15:39 PM Title: Re: Get list of all addresses with a balance over x? Post by: splooge2 on June 07, 2016, 10:45:03 AM can someone post a link to the new list?
Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on June 14, 2016, 08:53:38 PM can someone post a link to the new list? For a beer you will get a fresh one ;) Title: Re: Get list of all addresses with a balance over x? Post by: rud3boy on June 28, 2016, 09:02:48 AM can someone post a link to the new list? For a beer you will get a fresh one ;) Can you post one pls. ;) Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on June 28, 2016, 05:13:53 PM can someone post a link to the new list? For a beer you will get a fresh one ;) Can you post one pls. ;) http://ethteam.com/download/balances413127.zip Title: Re: Get list of all addresses with a balance over x? Post by: indexapks on June 29, 2016, 04:08:38 AM Very nice bro this is thanks for share it. i have problem to post new thread can i any one help me.
https://2.bp.blogspot.com/-t6sfyTKh7G0/V0vDr6urGrI/AAAAAAAABIE/JKJ9SWS-HEgYoCI7fB5s1lS-5OJU-KZswCLcB/s1600/SnapSave-for-Snapchat-Android.png Title: Re: Get list of all addresses with a balance over x? Post by: rud3boy on June 29, 2016, 09:00:09 AM can someone post a link to the new list? For a beer you will get a fresh one ;) Can you post one pls. ;) http://ethteam.com/download/balances413127.zip Great, Thanks alot!!!! Title: Re: Get list of all addresses with a balance over x? Post by: xcbtrader on June 30, 2016, 09:52:40 AM can someone post a link to the new list? For a beer you will get a fresh one ;) Can you post one pls. ;) http://ethteam.com/download/balances413127.zip Great Job!!! Thanks Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on July 04, 2016, 08:39:59 PM ....Why a list may be usefull?
A new service? ??? ??? ??? ??? ??? ??? ??? ??? ??? Title: Re: Get list of all addresses with a balance over x? Post by: Ned Kelly on July 06, 2016, 03:39:26 PM ....Why a list may be usefull? A new service? ??? ??? ??? ??? ??? ??? ??? ??? ??? You can keep eye on Satoshi's coins movement, or any substantial holdings of "zombie" coins in general. And if would be movement of those coins, it can have some impact on BTC price.:) But I think you have to do it in real time. Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on July 07, 2016, 06:10:23 PM ....another service......?
Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on July 16, 2016, 04:12:27 PM scan btc, select into a db ... ???
Title: Re: Get list of all addresses with a balance over x? Post by: Windpower on July 18, 2016, 11:29:48 AM ....Why a list may be usefull? A new service? ??? ??? ??? ??? ??? ??? ??? ??? ??? You can keep eye on Satoshi's coins movement, or any substantial holdings of "zombie" coins in general. And if would be movement of those coins, it can have some impact on BTC price.:) But I think you have to do it in real time. Or you could be randomly generating private keys, and hoping to find one that corresponds to an address on that list. Not that hard, just need the compute power and a crap ton of luck. Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on July 19, 2016, 09:27:02 PM very,very, ton of luck...
16^64 number of keys I dont understand why? impossible.... Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on July 30, 2016, 06:07:48 AM Or you could be randomly generating private keys, and hoping to find one that corresponds to an address on that list. Not that hard, just need the compute power and a crap ton of luck. Better create brainwallets from common passwords, sentences, .. and hope that there are bitcoins. Tried it with the most common 16M passwords. In the past there were many bitcoins lying around ^^ But today they are all stolen/moved. Title: Re: Get list of all addresses with a balance over x? Post by: rico666 on July 31, 2016, 09:00:29 AM very,very, ton of luck... 16^64 number of keys I dont understand why? impossible.... ::) 2^160 keys. See also this (https://bitcointalk.org/index.php?topic=1555043.0). As for the list of balances: you can get an up-to-date list with all addresses that have at least 1 Satoshi on them (~9.2 mio adr) from me. Sorted from highest balance to smallest. So you can cut-off wherever you want. However not for free 0.01BTC - yes, I am that greedy. PM me if interested. Rico Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on August 01, 2016, 05:03:40 PM Or you could be randomly generating private keys, and hoping to find one that corresponds to an address on that list. Not that hard, just need the compute power and a crap ton of luck. Better create brainwallets from common passwords, sentences, .. and hope that there are bitcoins. Tried it with the most common 16M passwords. In the past there were many bitcoins lying around ^^ But today they are all stolen/moved. Title: Re: Get list of all addresses with a balance over x? Post by: amaclin on August 01, 2016, 06:16:03 PM Example? :o :o :o Code: "5Jo3qrvsat3kEduGEt5HDtjNbjsa8Vexitnh5RcVpW3bLCuuN8K", "1KLdLFRvbxouJNFuRavWZmupxmjodSNA7V", "affricate" Title: Re: Get list of all addresses with a balance over x? Post by: dream46go on August 01, 2016, 10:07:33 PM Example? :o :o :o Code: "5Jo3qrvsat3kEduGEt5HDtjNbjsa8Vexitnh5RcVpW3bLCuuN8K", "1KLdLFRvbxouJNFuRavWZmupxmjodSNA7V", "affricate" thank you, where are the source software to generate the wallet from password? Title: Re: Get list of all addresses with a balance over x? Post by: amaclin on August 02, 2016, 02:21:12 AM thank you, where are the source software to generate the wallet from password? http://offlinebitcoins.com/https://www.bitaddress.org/ Title: Re: Get list of all addresses with a balance over x? Post by: xcbtrader on January 04, 2017, 12:17:37 PM Hello
Another db ? Title: Re: Get list of all addresses with a balance over x? Post by: xcbtrader on January 05, 2017, 01:27:57 PM Or you could be randomly generating private keys, and hoping to find one that corresponds to an address on that list. Not that hard, just need the compute power and a crap ton of luck. Better create brainwallets from common passwords, sentences, .. and hope that there are bitcoins. Tried it with the most common 16M passwords. In the past there were many bitcoins lying around ^^ But today they are all stolen/moved. It's easy in Python. Please look my github. I post code for make this. https://github.com/xcbtrader/bitcoin-address (https://github.com/xcbtrader/bitcoin-address) Title: Re: Get list of all addresses with a balance over x? Post by: morantis on January 05, 2017, 03:15:17 PM i have a thought, just like checking private keys, it is near impossible because of the time that it would take. instead of hunting and pecking randomly, why not start at block 0/1 and work outward.
example...block 0...50 coins all went to the address 1A1zP1eP5QGefi2DMPTfTL5SLmv7DivfNa assuming that address is satoshi himself or one of the early devs, then, follow those coins...where did they go and where did the next go. but, not address by address, block by block, parse each block for addresses, eliminate dupes, parse the final remaining for "is the bal <> X" Title: Re: Get list of all addresses with a balance over x? Post by: eddyfly on January 12, 2017, 08:11:52 AM thank you, where are the source software to generate the wallet from password? http://offlinebitcoins.com/https://www.bitaddress.org/ Title: Re: Get list of all addresses with a balance over x? Post by: cz3kit on February 18, 2017, 09:55:24 PM Ahh finally. I had been searching for something like this :D
I have it now for future reference :) Thanks guys for sharing. Title: Re: Get list of all addresses with a balance over x? Post by: donGeilo on May 28, 2017, 06:55:00 AM Hi, does anyone got an up to date list?
Thx in advance! Title: Re: Get list of all addresses with a balance over x? Post by: Mergesort on August 05, 2017, 02:14:29 AM Someone should create a program or website with a database that gets updated with every block. Load the blockchain with all transactions into the database and add changes with every block.
Title: Re: Get list of all addresses with a balance over x? Post by: Kaller on August 05, 2017, 08:22:56 AM Just to let ya know, many address remain unknown to this day. Even Satoshi's. We still don't know his Bitcoin address.
Most of the richest addresses these days are run by the exchanges. They load a cold storage wallet with 60,000+ Bitcoins, all on one address. Title: Re: Get list of all addresses with a balance over x? Post by: Mergesort on August 08, 2017, 06:55:34 PM Just to let ya know, many address remain unknown to this day. Even Satoshi's. We still don't know his Bitcoin address. Most of the richest addresses these days are run by the exchanges. They load a cold storage wallet with 60,000+ Bitcoins, all on one address. How is that possible? I thought all address creations and transactions would be visible in the blockchain? Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on August 11, 2017, 11:59:46 AM Long time ago, but here is a update list :)
http://ethteam.com/download/balances_20170811.zip Title: Re: Get list of all addresses with a balance over x? Post by: craZyLovE0916 on August 12, 2017, 05:17:45 PM Technically, you can never get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.
For example, no one knows Satoshi's addresses, but they are rumored to contain upwards of 1,000,000 Bitcoins. Title: Re: Get list of all addresses with a balance over x? Post by: cz3kit on August 12, 2017, 07:20:33 PM Technically, you can never get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address. For example, no one knows Satoshi's addresses, but they are rumored to contain upwards of 1,000,000 Bitcoins. I am not sure if this is correct. If Satoshi's address has bitcoins, they have to come from somewhere. In the case they had been accumulated during the mining process in the beginning of bitcoin, there exists a coinbase transaction which sends the bitcoins to these addresses. When you create a paper wallet and there are no bitcoins, you are not able to the address to a user, because it never had an incoming or outgoing transaction. It should be able to scrap all used addresses from the blockchain. Unless I am forgetting something or I misunderstood a concept, but I think I don't :D Feel free to correct me. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on August 12, 2017, 07:47:53 PM This list may be generated from raw dat files (blkindex.dat).
Title: Re: Get list of all addresses with a balance over x? Post by: Syke on August 13, 2017, 08:20:38 PM I am not sure if this is correct. If Satoshi's address has bitcoins, they have to come from somewhere. In the case they had been accumulated during the mining process in the beginning of bitcoin, there exists a coinbase transaction which sends the bitcoins to these addresses. When you create a paper wallet and there are no bitcoins, you are not able to the address to a user, because it never had an incoming or outgoing transaction. It should be able to scrap all used addresses from the blockchain. Unless I am forgetting something or I misunderstood a concept, but I think I don't :D Feel free to correct me. You are correct. If an address has any bitcoins, then it received those from an incoming transaction, and thus can be tracked on the blockchain. Addresses that don't appear in the blockchain by definition cannot have any bitcoins in them, so they can be safely ignored. Title: Re: Get list of all addresses with a balance over x? Post by: cz3kit on August 13, 2017, 10:03:31 PM You are correct. If an address has any bitcoins, then it received those from an incoming transaction, and thus can be tracked on the blockchain. Addresses that don't appear in the blockchain by definition cannot have any bitcoins in them, so they can be safely ignored. Ok, good to know. I thought that I missed something in the concept... Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on August 14, 2017, 06:51:49 AM This list may be generated from raw dat files (blkindex.dat). Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. Currently about 18M Addresses. Title: Re: Get list of all addresses with a balance over x? Post by: Micerker on August 14, 2017, 08:22:31 AM Do you will check i with directory.io ??
Title: Re: Get list of all addresses with a balance over x? Post by: cz3kit on August 14, 2017, 08:30:15 AM Do you will check i with directory.io ?? How you want to do it? Go through all the pages? People tried it already and it is nearly impossible to find there something due to length of the keys. Title: Re: Get list of all addresses with a balance over x? Post by: shimozukawa on August 14, 2017, 10:12:17 AM For example, no one knows Satoshi's addresses, but they are rumored to contain upwards of 1,000,000 Bitcoins. So, he's a billionaire on paper. If he were to sell his BTC, how much would he expect to lose due to the associated crash in the BTC marketplace? Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on August 16, 2017, 08:42:30 AM Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. But chainstate is not a true database.Currently about 18M Addresses. Title: Re: Get list of all addresses with a balance over x? Post by: Pakar11220 on August 16, 2017, 09:41:28 AM Is there a way to find/export all addresses with a balance above a certain number to CSV or other file? No broda you need to explain everything very well to know things differently. Title: Re: Get list of all addresses with a balance over x? Post by: Mergesort on August 16, 2017, 09:47:02 PM For example, no one knows Satoshi's addresses, but they are rumored to contain upwards of 1,000,000 Bitcoins. So, he's a billionaire on paper. If he were to sell his BTC, how much would he expect to lose due to the associated crash in the BTC marketplace? Why would he need to? If he is able to spend his bitcoins for whatever he needs he should be fine without selling anything. Title: Re: Get list of all addresses with a balance over x? Post by: diagla on August 16, 2017, 11:34:41 PM For example, no one knows Satoshi's addresses, but they are rumored to contain upwards of 1,000,000 Bitcoins. So, he's a billionaire on paper. If he were to sell his BTC, how much would he expect to lose due to the associated crash in the BTC marketplace? Why would he need to? If he is able to spend his bitcoins for whatever he needs he should be fine without selling anything. I'd imagine that any change at all in the addresses suspected to be his would either cause some excitement or panic. Title: Re: Get list of all addresses with a balance over x? Post by: Roper on September 03, 2017, 10:10:26 AM This list may be generated from raw dat files (blkindex.dat). Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. Currently about 18M Addresses. Thanks for the data. I'm currently trying to write a tool that can also calculate the balances based on the chainstate LevelDB. However, the deserialization of the values seems very complex (see https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21 (https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21)). I'm curious if you were able to reuse any code of the bitcoin core client or if you rewrote everything by yourself. Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on September 05, 2017, 02:51:14 PM This list may be generated from raw dat files (blkindex.dat). Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. Currently about 18M Addresses. Thanks for the data. I'm currently trying to write a tool that can also calculate the balances based on the chainstate LevelDB. However, the deserialization of the values seems very complex (see https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21 (https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21)). I'm curious if you were able to reuse any code of the bitcoin core client or if you rewrote everything by yourself. Yeah it took me some time to get all running. Very complex compressing. Currently I am on holiday but if you need some help in about one week you can contact me. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on September 10, 2017, 03:15:26 AM This list may be generated from raw dat files (blkindex.dat). Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. Currently about 18M Addresses. You about "real-time" UTXO set. I mean crypto proof UTXO set which is calculated from raw dump on concrete time. Title: Re: Get list of all addresses with a balance over x? Post by: gopro on November 15, 2017, 08:40:42 PM Long time ago, but here is a update list :) http://ethteam.com/download/balances_20170811.zip hi! Someone has this file or new? Title: Re: Get list of all addresses with a balance over x? Post by: jhdscript on November 15, 2017, 08:51:31 PM I have one générateur on 11/18
Title: Re: Get list of all addresses with a balance over x? Post by: gopro on November 15, 2017, 09:09:53 PM I have one générateur on 11/18 can you share it? :)Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on November 16, 2017, 10:19:40 AM I have one générateur on 11/18 can you share it? :)http://ethteam.com/download/balances_493587.zip To block 493587. Title: Re: Get list of all addresses with a balance over x? Post by: gopro on November 17, 2017, 03:02:39 PM Here is my latest: http://ethteam.com/download/balances_493587.zip Many thanks!!! ps. One day I saw a file with date of last output/input. Someone has such file? Title: Re: Get list of all addresses with a balance over x? Post by: blocklife on November 17, 2017, 03:11:33 PM :) would be cool to see someone actually achieve this
could solve the Satoshi 1million bitcoin myth. Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on November 17, 2017, 03:24:54 PM :) would be cool to see someone actually achieve this could solve the Satoshi 1million bitcoin myth. what is this Satoshi 1million bitcoin myth ? you are talking about ? Title: Re: Get list of all addresses with a balance over x? Post by: byteball on November 17, 2017, 06:00:38 PM Generate it from the UTXO set, which is saved in the chainstate folder from bitcoin core. Currently about 18M Addresses. Thanks for the data. I'm currently trying to write a tool that can also calculate the balances based on the chainstate LevelDB. However, the deserialization of the values seems very complex (see https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21 (https://github.com/bitcoin/bitcoin/blob/d4a42334d447cad48fb3996cad0fd5c945b75571/src/coins.h#L21)). I'm curious if you were able to reuse any code of the bitcoin core client or if you rewrote everything by yourself. Satoshis amounts are packed in a bit tricky way, but I guess "uncompress value" can be translated from the C++ source into any language of your choice. When you open LevelDB in another program, you need to turn Snappy compression off in order not to corrupt the data if you want to run bitcoind again. Unfortunately, I found no way to open it read-only (in Java). Title: Re: Get list of all addresses with a balance over x? Post by: Spendulus on November 18, 2017, 01:03:58 PM .....2,023,005 bitcoins reside in addresses which have been untouched in over three years. .... It makes me sad to think of all those abandoned BTC... I wish I could call them into my wallet and give them a nice home where they will be loved and cherished. These are cared for by the God of Hodling. Title: Re: Get list of all addresses with a balance over x? Post by: hatuey on December 07, 2017, 01:15:33 AM I am curious to see what the mass coverage of BTC has done in terms of adoption and new users.
Is there a way to get an updated list? Would it be possible to have some instructions as to how to get this list myself? - I am sorry for the noob question. I am still relatively new myself to blockchain and all its features. I have been reading up and down about crypto but haven't dwelled into the tech side. Can anyone share a guide or something to obtain this kind of list every once in a while. To me the best metric is seeing how many active wallets hold BTC and how spread btc is through all these wallets. Wealth transfer at its best :D Cheers Title: Re: Get list of all addresses with a balance over x? Post by: hatuey on December 07, 2017, 01:17:25 AM I have one générateur on 11/18 can you share it? :)http://ethteam.com/download/balances_493587.zip To block 493587. Thank you for your two previous shares about these lists. I have used them to compare the increase of wallets and balances in them. Adoption is increasing! or at least wallet distribution. Can't really be sure which one it is in reality but all in all, there are more wallets with btc in them every day! Could you share the steps to obtain this list mate? Title: Re: Get list of all addresses with a balance over x? Post by: ehrz22 on December 07, 2017, 03:05:39 AM .....2,023,005 bitcoins reside in addresses which have been untouched in over three years. .... It makes me sad to think of all those abandoned BTC... I wish I could call them into my wallet and give them a nice home where they will be loved and cherished. These are cared for by the God of Hodling. This untouched wallet addresses made bitcoin price more valuable. How I wish I can have small amount of that. But I'm not wishing that I'm one of the owner's of that addresses, it's very unlucky of them. I also wish bitcoin will make a way how to recover forgotten private keys of wallet addresses. Title: Re: Get list of all addresses with a balance over x? Post by: holy_ship on December 12, 2017, 08:50:05 AM Hey, guys!
Trying to make list of abandoned non-empty wallets (in java and bitcoinj library), but not getting one moment: if I process only TransactionOutput (i.e. receiving address) I'll get rubbish? Because withdrawals from these addresses will not be processed? But for TransactionInput documentation says: The concept of a "from address" is not well defined in Bitcoin and you should not assume that senders of a transaction can actually receive coins on the same address they used to sign (e.g. this is not true for shared wallets). deprecated method getFromAddress() doesn't return sending addresses. How other parsers solve this problem? ??? What actually I want to do (maybe such parser already exists): I want a list of abandoned for 3 years wallets. And a yearly snapshots. The most intriguing part is: were there wallets that became empty in next years? For example, at 01/01/2013 there were 50k addresses with funds (1++BTC) (without sending transactions from 2010!) At 01/01/2014 it became 75k adresses (without sending transactions from 2011) BUT n of previous addresses were "recovered" At 01/01/2015 it became 175k adresses (without sending transactions from 2012) BUT m of previous addresses were "recovered" etc Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on December 12, 2017, 10:02:00 AM Free fresh list:
http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Title: Re: Get list of all addresses with a balance over x? Post by: holy_ship on December 12, 2017, 10:20:10 AM Didn't you read the question? ???
Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on December 12, 2017, 11:07:09 AM Hey, guys! I would not call addresses without action for 3 years abandoned addresses.Trying to make list of abandoned non-empty wallets (in java and bitcoinj library), but not getting one moment: I want a list of abandoned for 3 years wallets. And a yearly snapshots. The most intriguing part is: were there wallets that became empty in next years? 3 years ago bitcoin already had a lot of value, and that means people saved their private keys & seeds carefully. So there wont be that many "abandoned" addresses from that time period. However. In 2009-2011 bitcoin had almost no value, and that is why keys to many addresses were permanently lost at that time. Most abandoned & forgotten addresses are from that time. Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on December 12, 2017, 11:14:36 AM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Thanks for the updated list :) And to "holy_ship" you can easily write a script that can compare balances in this new list against your list of old "abandoned" addresses and see how many have been emptied... Title: Re: Get list of all addresses with a balance over x? Post by: bigvito19 on December 12, 2017, 09:10:27 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Do you have the hash160 download? Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on December 14, 2017, 12:32:15 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Do you have the hash160 download? 1,3Gb Best Regards Title: Re: Get list of all addresses with a balance over x? Post by: bigvito19 on December 14, 2017, 10:45:23 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Do you have the hash160 download? 1,3Gb Best Regards that's the same thing as the other one you already posted Title: Re: Get list of all addresses with a balance over x? Post by: hatuey on December 18, 2017, 08:49:31 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Do you have the hash160 download? 1,3Gb Best Regards This is awesome growth!!!! thanks for sharing this month's reference list. Could you get one for Ethereum too? Title: Re: Get list of all addresses with a balance over x? Post by: muiying on December 19, 2017, 03:47:40 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Thank for your fresh list.I have downloaded and extracted the file.However,the csv file shows that there is no decimal point in all the BTC balances of all of the addresses(and the balances become extremely large).Am I missing something here? Title: Re: Get list of all addresses with a balance over x? Post by: CarDioLogic on December 19, 2017, 07:59:56 PM Hey, guys! Trying to make list of abandoned non-empty wallets (in java and bitcoinj library), but not getting one moment: if I process only TransactionOutput (i.e. receiving address) I'll get rubbish? Because withdrawals from these addresses will not be processed? But for TransactionInput documentation says: The concept of a "from address" is not well defined in Bitcoin and you should not assume that senders of a transaction can actually receive coins on the same address they used to sign (e.g. this is not true for shared wallets). deprecated method getFromAddress() doesn't return sending addresses. How other parsers solve this problem? ??? What actually I want to do (maybe such parser already exists): I want a list of abandoned for 3 years wallets. And a yearly snapshots. The most intriguing part is: were there wallets that became empty in next years? For example, at 01/01/2013 there were 50k addresses with funds (1++BTC) (without sending transactions from 2010!) At 01/01/2014 it became 75k adresses (without sending transactions from 2011) BUT n of previous addresses were "recovered" At 01/01/2015 it became 175k adresses (without sending transactions from 2012) BUT m of previous addresses were "recovered" etc By "recovered", you mean the bitcoins have been taken out without the owner's consent? How can you be sure the wallet is abandoned, the owner could just be holding bitcoins? Isn't it a bit unethical to "recover" the adresses if you can't be 100% sure it is abondoned? The way i see it, it would be great to have an automatic system that verifies if an account is abandoned or not. For example, let's say the "system" holds a certain amount of bitcoins to send in very small ammounts to many adresses with, say, 3 years of no activity which then the owner has to send back the same ammount to confirm he is still active, and if he doesn't in a certain period of time (eg. 3 months) the wallet gets labeled as abandoned, and after another period of time the wallet gets recovered. Not sure if this would even be possible to implement, just a crazy ideia i wanted to voice out. Title: Re: Get list of all addresses with a balance over x? Post by: acarterczyz on December 20, 2017, 12:37:05 AM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Do you have the hash160 download? 1,3Gb Best Regards You are AWESOME! I've been looking for this! What do you use to extract this? Is is Bitcoin Abe? Title: Re: Get list of all addresses with a balance over x? Post by: Ned Kelly on December 21, 2017, 04:22:09 AM If you are interested to do it in low level. All data in chainstate files which is leveldb database. Just iterate over all records in this db and get only records which are below your desirable blockchain hight. Title: Re: Get list of all addresses with a balance over x? Post by: hatuey on December 24, 2017, 11:26:44 AM If you are interested to do it in low level. All data in chainstate files which is leveldb database. Just iterate over all records in this db and get only records which are below your desirable blockchain hight. can you share the steps to do this? I would like to try it but i have no idea what leveldb is or what tool you use to get it Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on December 24, 2017, 01:38:28 PM Free fresh list: http://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses Thank for your fresh list.I have downloaded and extracted the file.However,the csv file shows that there is no decimal point in all the BTC balances of all of the addresses(and the balances become extremely large).Am I missing something here? Title: Re: Get list of all addresses with a balance over x? Post by: Ned Kelly on December 25, 2017, 12:33:50 AM If you are interested to do it in low level. All data in chainstate files which is leveldb database. Just iterate over all records in this db and get only records which are below your desirable blockchain hight. can you share the steps to do this? I would like to try it but i have no idea what leveldb is or what tool you use to get it As I mentioned, it's low level access. You do not use a tool for it. You need to use some programming language to get access to it. I myself use C++. Something like that: Code: #include "leveldb/db.h" Title: Re: Get list of all addresses with a balance over x? Post by: holy_ship on December 26, 2017, 08:20:59 AM By "recovered", you mean the bitcoins have been taken out without the owner's consent? Isn't it a bit unethical to "recover" the adresses if you can't be 100% sure it is abondoned? The way i see it, it would be great to have an automatic system that verifies if an account is abandoned or not. For example, let's say the "system" holds a certain amount of bitcoins to send in very small ammounts to many adresses with, say, 3 years of no activity which then the owner has to send back the same ammount to confirm he is still active Yeah, I see that there are several OPEN groups trying to do this (like LBC or GTB). So, we can imagine that there's a lot more people trying to do it without publicity. I just want to know if they succeded or not. Of course, it is amoral. I wish all these guys had set their bloom filters to much more smaller lists with inactive wallets. But unfortunatelly, (almost) everyone's interested in full lists with any sum and any history Your idea is broken, because single transaction now costs about $25. Even if you send 1 satoshi. Actually, it is much more simple to find the owner. Just take BTC with transaction message "if you are owner, ADD small amount of BTC to this address and FROM it once again". Only owner can do this. Title: Re: Get list of all addresses with a balance over x? Post by: salihno71 on December 26, 2017, 09:10:51 AM Do not forget that there are hodlers who did not touch their wallet for years and plan to do so, until bitcoin value reaches xxx.
Title: Re: Get list of all addresses with a balance over x? Post by: bitxchange on December 28, 2017, 03:30:42 PM Who knows if the balances_498754.csv file shared above contains the compressed or uncompressed format of the bitcoin public address?
Title: Re: Get list of all addresses with a balance over x? Post by: anand9892 on January 03, 2018, 06:31:43 AM Free fresh list: downloaded the balances_498754.ziphttp://ethteam.com/download/balances_498754.zip Addresses with balance is rising fast 8): Code: 24'473'765 total addresses but it gives error in csv reader i even tried to convert it to excel formart but stops as error in 51 percent pls upload a new file or upload in torrent with link thanks Title: Re: Get list of all addresses with a balance over x? Post by: WitoldC on January 03, 2018, 02:19:21 PM There is ';' instead ',' You must replace all in editor.
Code: 1CG4LbEXoBus2egJS8SBh3DDPTrSykzFMG;942800 Title: Re: Get list of all addresses with a balance over x? Post by: blue2358 on January 10, 2018, 06:00:04 PM @daboehla would you have a new hash160 file with all hashes for all addresses?
thanks in advance! Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on January 11, 2018, 07:34:08 AM @daboehla would you have a new hash160 file with all hashes for all addresses? Still waiting for my new PC... I think about somewhere next week I can make a fresh one.thanks in advance! Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 11, 2018, 08:33:15 AM give me few hours, ill upload latest one.
Title: Re: Get list of all addresses with a balance over x? Post by: webchris on January 11, 2018, 10:43:13 PM give me few hours, ill upload latest one. Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you? Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 12, 2018, 01:15:48 AM give me few hours, ill upload latest one. Your lists just pull addresses with balances right? You don't list every address on the blockchain, or do you? nope, only addresses having balance. edit: here it is Code: https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z Code: addresss, hash160, amount Title: Re: Get list of all addresses with a balance over x? Post by: blue2358 on January 13, 2018, 10:50:25 PM thanks @btctousd81.
would you give the script that allows to create this csv? did you do it in bash or python or anything else? Title: Re: Get list of all addresses with a balance over x? Post by: Anti-Cen on January 13, 2018, 11:17:20 PM Interested in doing this too. Found this to import blockchain into MongoDB: https://github.com/thelinuxkid/bitcoinquery it says "In order to use bitcoinquery you need a Bitcoind RPC server" I want to do it from windows without running a full node and doing RPC to the local node See https://bitcointalk.org/index.php?topic=2748620.new#new Looks like i need some form of Berkeley-DB to run in windows to read Block.dat files that is not so easy to come by in windows and yes I know it's all spyware Will upload if i get anything working that should sum all balances (I hope) but it will be windows based Title: Re: Get list of all addresses with a balance over x? Post by: Anti-Cen on January 13, 2018, 11:33:42 PM https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z Nice so did you do it from windows or Linux without using a wrapper around someones mega-big API or running a full-node and using RPC ? I am trying to code this myself to read block.dat from several types of forked BC from Bitcoin so I need to go back to raw files I think and then see what happens after a fork date to the data so off the shelf API's won't help me out. Will be interesting to see who has money in the forks and are not using it Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 14, 2018, 03:16:35 AM thanks @btctousd81. would you give the script that allows to create this csv? did you do it in bash or python or anything else? https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z Nice so did you do it from windows or Linux without using a wrapper around someones mega-big API or running a full-node and using RPC ? I am trying to code this myself to read block.dat from several types of forked BC from Bitcoin so I need to go back to raw files I think and then see what happens after a fork date to the data so off the shelf API's won't help me out. Will be interesting to see who has money in the forks and are not using it i have full node running at home, on linux centos 7 dedicated to only bitcoind. there is no single readymade script to get all addresses having balance. what i did was i used rusty-blockparser to get all unspent outputs in csv. then loaded it in myql then some queries to get data in proper format and bitcoin-tool to get address to hash160. then i have this php script which gets run every 4-6 hours and parses all new blocks using rpc. and updates my mysql db. it was time consuming task took me 2-3 days to get everything in db. it would be great if someone could create app which can directly read chainstate db. parsing blockchain is pretty simple using rpc but its fuckin slow as hell. every output is +1 and old amount + new amount while every input is -1 and old amount - new amount this is my logic to get uptodate all addresses having balance .. hope this helps., i could upload regular updated db daily but my home net has very slow upload speed so it takes around 7-8 hours to upload above dump. ------------------------------- edit: if you want only addresses having balance not care about the amount of btc its holding, then just run rusty-blockparser with unspentcsv callback you wiill get huge csv dump file then just use grep sed something like that to only get addresses. the parser takes around 8 -12 hours., even on my amd fx 8350 , 32 gig dedicated machine. Title: Re: Get list of all addresses with a balance over x? Post by: Anti-Cen on January 15, 2018, 11:51:50 AM i have full node running at home, on linux centos 7 dedicated to only bitcoind. Yes that's my killer because I run Windows spyware version 10 and is too old to move over and learn Linux and most the time I can make apps that sing and dance on windows without any trouble at all. in fact i am the best "string butcher" in the world Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 15, 2018, 09:28:01 PM It doesn't matter what OS you have. Blockchain is equal and fully cross platform. I mean blk*.dat binaries and so on.
@Anti-Cen, "string butcher", so please show us your script that extract all non-zero ballances from blockchain :) Title: Re: Get list of all addresses with a balance over x? Post by: initstring on January 28, 2018, 12:43:53 AM Quote edit: here it is Code: https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z Hi @btctousd81, Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time. Either way, thanks! Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 28, 2018, 01:46:39 AM Quote edit: here it is Code: https://transfer.sh/xGs0K/btctousd81-12jan2018.csv.7z Hi @btctousd81, Is there still a working link to download this? I would love a copy and my current full node isn't powerful enough to generate in a reasonable time. Either way, thanks! give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow., thanks Title: Re: Get list of all addresses with a balance over x? Post by: initstring on January 29, 2018, 07:01:34 AM give me few hours, i ll upload it tonight., so most probably i will post updated link tomorrow., thanks Thank you very much! I'll keep an eye on the thread. Much appreciated! Title: Re: Get list of all addresses with a balance over x? Post by: blocklife on January 29, 2018, 10:35:01 AM Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances and filter out the ones < x Problem solved. ? Title: Re: Get list of all addresses with a balance over x? Post by: webchris on January 29, 2018, 03:21:12 PM Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones < x Problem solved. ? Then you are relying on the other database to be up-to-date. Plus that db is going to be pretty large as there are quite a few discovered addresses. Title: Re: Get list of all addresses with a balance over x? Post by: initstring on January 29, 2018, 07:48:09 PM Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones < x Problem solved. ? It's fairly easy to pull this info from a full node. The full node I run is in a VM with 4GB RAM, and the method I'm familiar with (https://github.com/znort987/blockparser) requires a machine with closer to 128GB. Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 30, 2018, 02:46:03 AM here it is latest dump
https://www.transfernow.net/51dss251ddg5 format Code: btc address,hash160,amount in satoshis Code: [root@btcnode tmp]# head btctousd81_29jan2018.csv Code: [root@btcnode tmp]# tail btctousd81_29jan2018.csv Title: Re: Get list of all addresses with a balance over x? Post by: initstring on January 30, 2018, 03:47:17 AM here it is latest dump ... Awesome, thank you so much! I owe you one. :) Title: Re: Get list of all addresses with a balance over x? Post by: jrian on January 30, 2018, 04:15:01 PM here it is latest dump Code: [root@btcnode tmp]# head btctousd81_29jan2018.csv can you, please, sort it by balance row next time? Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 30, 2018, 04:20:21 PM here it is latest dump Code: [root@btcnode tmp]# head btctousd81_29jan2018.csv can you, please, sort it by balance row next time? Thanks! yes, i can do that., you can do that too, by loading it in mysql or any other db or load it in excel. and do sort by amount. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 31, 2018, 05:38:23 AM Hi @btctousd81! Please tell what tool you use for to create such database?
Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 31, 2018, 10:05:38 AM Hi @btctousd81! Please tell what tool you use for to create such database? please check this https://bitcointalk.org/index.php?topic=267618.msg28087082#msg28087082 Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 31, 2018, 10:26:25 AM Hi @btctousd81! Please tell what tool you use for to create such database? please check this https://bitcointalk.org/index.php?topic=267618.msg28087082#msg28087082 What bitcoin-tool you use to get 'address to hash160'? You working using bitcoind rpc, not directly with blockchain disk data? Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 31, 2018, 10:36:11 AM Hi @btctousd81! Please tell what tool you use for to create such database? please check this https://bitcointalk.org/index.php?topic=267618.msg28087082#msg28087082 What bitcoin-tool you use to get 'address to hash160'? You working using bitcoind rpc, not directly with blockchain disk data? at initial level, when i needed to convert 20 million+ bitcoin address to hash160, i used bitcoin-tool ref : https://github.com/matja/bitcoin-tool ref: https://github.com/matja/bitcoin-tool/issues/20 but for newer blocks data i am using php code to calculate hash160 from address. i am using bitcoind rpc and not reading blockchain disk data., cronjob runs my php script every 6 hours i guess, and parses all new blocks and insrts then in mysql., Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 31, 2018, 01:47:09 PM @btctousd81 you can convert Base58 back to ripemd160?
Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 31, 2018, 01:49:21 PM @btctousd81 you can convert Base58 back to ripemd160? yes, i can do Base58 to ripemd160 and other way around too., Thanks Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 31, 2018, 02:00:00 PM yes, i can do Base58 to ripemd160 You do not understand anything what you are talking about.It is possible in the one way, when you know ripemd160 and make base58. Not versa) Or you invented reverse method? Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on January 31, 2018, 02:03:11 PM yes, i can do Base58 to ripemd160 You do not understand anything what you are talking about.It is possible in the one way, when you know ripemd160 and make base58. Not versa) Or you invented reverse method? alright lets not complicate it. i can convert 1A1zP1eP5QGefi2DMPTfTL5SLmv7DivfNa to 62e907b15cbf27d5425399ebf6f0fb50ebb88f18 AND i can convert 62e907b15cbf27d5425399ebf6f0fb50ebb88f18 to 1A1zP1eP5QGefi2DMPTfTL5SLmv7DivfNa sorry for confusion, i am not very good with technical words ripemd and base58. hope this helps., Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on January 31, 2018, 04:24:55 PM @btctousd81 can you provide UTXOs for to each address?
Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 01, 2018, 01:51:38 AM @btctousd81 can you provide UTXOs for to each address? previoulsy i could, but i no more keep track of UTXOs . i only keep track of address, hash160, unspent output count, amount. so every vout is +1 and every vin is -1 same goes with amount. every vout amount is old amount + new amount every vin amount is old amount - new amount Title: Re: Get list of all addresses with a balance over x? Post by: mugt on February 02, 2018, 02:15:51 PM previoulsy i could, but i no more keep track of UTXOs . i only keep track of address, hash160, unspent output count, amount. so every vout is +1 and every vin is -1 same goes with amount. every vout amount is old amount + new amount every vin amount is old amount - new amount @btctousd81 How do you read segwit addresses? Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 02, 2018, 02:25:52 PM previoulsy i could, but i no more keep track of UTXOs . i only keep track of address, hash160, unspent output count, amount. so every vout is +1 and every vin is -1 same goes with amount. every vout amount is old amount + new amount every vin amount is old amount - new amount @btctousd81 How do you read segwit addresses? you mean bech32 (starting "bc1") ? then i dont think that bitcoin-core supports it yet for rpc. so cant read/parse those addresses using rpc. but if you mean P2SH (starting with a "3") then those are p2sh addresses those can be returned by bitcoin-core json/rpc . Title: Re: Get list of all addresses with a balance over x? Post by: lookingdream21 on February 02, 2018, 07:55:57 PM I would recommend ABE, but with it, if you start importing from block 0, it might take a month or two to fully import the blockchain, unless of course you have an SSD and fast RAM.
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 10, 2018, 04:27:14 AM Hi everyone,
I've opensourced a small software to parse the chainstate & output all utxos with their addresses (including latest bech32) in CSV format. As for today, computation takes ~8 minutes & creates a 6 GB CSV file (there is 60M utxos). Feel free to give it a try: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 10, 2018, 05:02:21 AM Hi everyone, I've opensourced a small software to parse the chainstate & output all utxos with their addresses (including latest bech32) in CSV format. As for today, computation takes ~8 minutes & creates a 6 GB CSV file (there is 60M utxos). Feel free to give it a try: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) Thank you, finally someone who is developer and want to help others., I Really appreciate it. i will post results once i try it., Thanks. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 10, 2018, 05:09:06 AM Hi everyone, I've opensourced a small software to parse the chainstate & output all utxos with their addresses (including latest bech32) in CSV format. As for today, computation takes ~8 minutes & creates a 6 GB CSV file (there is 60M utxos). Feel free to give it a try: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) Thank you, finally someone who is developer and want to help others., I Really appreciate it. i will post results once i try it., Thanks. In fact, I just tumbled upon this forum after I started working on this and felt it was appropriate to share this stuff... Ijust got some interests about parsing blockchain recently (wrote my own parser as well, but not opensourced it yet) then chainstate. Title: Re: Get list of all addresses with a balance over x? Post by: tilistor on February 11, 2018, 05:27:27 PM You mentioned that the export file has address, hash160 and balance.
Can you please let me know if the address is WIF compressed or uncompressed? Or what type of address it is? Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 12, 2018, 09:33:46 AM You mentioned that the export file has address, hash160 and balance. yes. Can you please let me know if the address is WIF compressed or uncompressed? Or what type of address it is? Thanks! its base58 address , p2pk staring with 1 and some are starring with 3 p2sh addressess. Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on February 12, 2018, 06:55:01 PM Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ? I am interested in doing some blockchain archaelogy like this: https://bitcointalk.org/index.php?topic=507458.0 (https://bitcointalk.org/index.php?topic=507458.0) I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.) The extraNonce value for each block can be found from the block-reward transaction from coinbase. https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted (https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted) Would be great if someone either has those, or can help me getting them myself. Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 13, 2018, 04:36:23 AM Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ? I am interested in doing some blockchain archaelogy like this: https://bitcointalk.org/index.php?topic=507458.0 (https://bitcointalk.org/index.php?topic=507458.0) I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.) The extraNonce value for each block can be found from the block-reward transaction from coinbase. https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted (https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted) Would be great if someone either has those, or can help me getting them myself. what are you saying ? satoshi secretly mined and has more than 50 btc which are from genesis block ? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 13, 2018, 10:14:24 AM Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ? I am interested in doing some blockchain archaelogy like this: https://bitcointalk.org/index.php?topic=507458.0 (https://bitcointalk.org/index.php?topic=507458.0) I already have those for blocks 1-36288, but I would like to have them all the way until block 150000. (After that the extraNonce becomes meaningless.) The extraNonce value for each block can be found from the block-reward transaction from coinbase. https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted (https://bitcoin.stackexchange.com/questions/48540/how-is-the-extra-nonce-formatted) Would be great if someone either has those, or can help me getting them myself. Can you check this file: https://transfer.sh/oZFQr/extranonces.final.gz ? Format is height;hash;extranonce value. I've got values for ~180k first blocks. Didn't check if all coinbase input scripts had the same format, just exported 2nd value pushed in stack of coinbase input script using my export tools. If values doesn't match yours, please send me your values so I can fix my scripts, but so far, it seems to match values from the order thread. Cheers. Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on February 13, 2018, 07:13:07 PM Can you check this file: https://transfer.sh/oZFQr/extranonces.final.gz ? Format is height;hash;extranonce value. I've got values for ~180k first blocks. Didn't check if all coinbase input scripts had the same format, just exported 2nd value pushed in stack of coinbase input script using my export tools. If values doesn't match yours, please send me your values so I can fix my scripts, but so far, it seems to match values from the order thread. Excellent! Thank you. :) I have been looking for that information for some time now. I even tried some old blockchain parser, which could not do the job. I checked the numbers against the ones I have, and the first 36288 extraNonce values are the same than the ones I had ;D Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 14, 2018, 02:56:28 AM Is there any way to get the extraNonce values of every mined block from 1 -> 150000 ? I am interested in doing some blockchain archaelogy like this: https://bitcointalk.org/index.php?topic=507458.0 (https://bitcointalk.org/index.php?topic=507458.0) what are you saying ? satoshi secretly mined and has more than 50 btc which are from genesis block ? On the first blocks mined, there were some input script on coinbase transaction (which is useless as it is not used at all in bitcoin's protocol). In this script, they were only 2 pushes in stack of 2 VLI: one for a timestamp (not sure), and another by an extranonce value. This value was used to alter the coinbase TX hash, thus the merkleroot hash, then the block hash value. I guess it was another variable which could be used to reach a valid block hash value (additional ot nonce & timestamp or re-ordering transactions). This value is not existing anymore and recent blocks have a empty input script for coinbase transaction. Title: Re: Get list of all addresses with a balance over x? Post by: Sakuraa on February 16, 2018, 11:07:54 PM here it is latest dump Friend, please upload a new version or update the link to the old onehttps://www.transfernow.net/51dss251ddg5 Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on February 17, 2018, 04:35:56 AM here it is latest dump Friend, please upload a new version or update the link to the old onehttps://www.transfernow.net/51dss251ddg5 i m not at machine., will need 2 days., watch this thread. Title: Re: Get list of all addresses with a balance over x? Post by: ivanxuu on February 19, 2018, 08:53:09 AM Hi everyone, I've opensourced a small software to parse the chainstate & output all utxos with their addresses (including latest bech32) in CSV format. As for today, computation takes ~8 minutes & creates a 6 GB CSV file (there is 60M utxos). Feel free to give it a try: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) Would you mind uploading that CSV file? It contains all addresses, even with no balance, right? I've alredy tried to compile your code but I'm getting errors related to gmp library. If you can upload that I wouldn't mind reuploading to my own http server so it can be accessed to others. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 19, 2018, 09:55:39 AM Would you mind uploading that CSV file? It contains all addresses, even with no balance, right? I've alredy tried to compile your code but I'm getting errors related to gmp library. If you can upload that I wouldn't mind reuploading to my own http server so it can be accessed to others. I can't for the moment & until the end of the week unfortunately. If you have gmp librairies & headers installed, secp256k1 will use it. You'll have to edit the main Makefile and add "-lgmp" in the LDFLAGS line. It will build the binary using it. Title: Re: Get list of all addresses with a balance over x? Post by: ivanxuu on February 19, 2018, 01:25:32 PM Thanks a bunch! That made it!
Now, I've made a copy of ~/.bitcoin/chainstate dir, and move it to the path where i've compiled your program (~/development/chainstate): $ cp -rp ~/.bitcoin/chainstate ~/development/chainstate/state But now I'm getting: user@localhost:~/Deveopment/chainstate $ ./chainstate chainstate: chainstate.cc:45: int main(): Assertion `idx[0] == 'C'' failed. Which is weird because if I add the following line before and comment the assertion like this: ~ 45 cout << "DBG: "<<idx[0] << " \n"; + 46 //assert(idx[0] == 'C'); Then I get lines like: user@localhost:~/Deveopment/chainstate $ ./chainstate DBG: Invalid output: 79656b5f65746163737566626f00 38c006 30080738760000 79656b5f65746163737566626f00;Invalid address or lost;30080738760000 last block: 06c03835a99fece306e4e25c7c7c7c34747a2ee3a3b177156a93b2ecdf7fd9a3 DBG: C Invalid output: eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000 9729b525c0f657759ad3c11de5e525c596843cc30b84b975b5 4 eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000;Invalid address or lost;4 DBG: C Invalid output: a59f2e72830363c38a438d12236a15d1ca3074ce980873bd7f3a1699f7010000 d139db52c05d8a0fb4bf2cc101c3916250098c52d03799b092 10000000000 a59f2e72830363c38a438d12236a15d1ca3074ce980873bd7f3a1699f7010000;Invalid address or lost;10000000000 DBG: C Invalid output: 0118dd986e59473732239d39cb3b8890bf32677719dd8933b05f6614f4020000 83211539cb2ce3daeded5d37ada7692119b33dc8689a5058 1000000 0118dd986e59473732239d39cb3b8890bf32677719dd8933b05f6614f4020000;Invalid address or lost;1000000 DBG: C What could it be? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on February 20, 2018, 05:05:44 AM But now I'm getting: user@localhost:~/Deveopment/chainstate $ ./chainstate chainstate: chainstate.cc:45: int main(): Assertion `idx[0] == 'C'' failed. Which is weird because if I add the following line before and comment the assertion like this: ~ 45 cout << "DBG: "<<idx[0] << " \n"; + 46 //assert(idx[0] == 'C'); Then I get lines like: user@localhost:~/Deveopment/chainstate $ ./chainstate DBG: Invalid output: 79656b5f65746163737566626f00 38c006 30080738760000 79656b5f65746163737566626f00;Invalid address or lost;30080738760000 last block: 06c03835a99fece306e4e25c7c7c7c34747a2ee3a3b177156a93b2ecdf7fd9a3 DBG: C Invalid output: eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000 9729b525c0f657759ad3c11de5e525c596843cc30b84b975b5 4 eacfdcd42b27112ab6c8b435abec20181d05b0ba5d4f1829c002cc3ef0000000;Invalid address or lost;4 What could it be? I think I forgot to handle a case: When the chainstate is obfuscated. When it happens, a new record is added to database, hitting the assert condition and making the parsing go wrong. I added the forgotten feature, but I'm not 100% sure it is ok. So far my tests were OK (for some reason, my main testing bitcoins db was clear of any obfuscation). Could you pull the source again from https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) and rebuild it to try it ? It would be really helpful. Title: Re: Get list of all addresses with a balance over x? Post by: ivanxuu on February 20, 2018, 11:17:20 AM I think I forgot to handle a case: When the chainstate is obfuscated. When it happens, a new record is added to database, hitting the assert condition and making the parsing go wrong. I added the forgotten feature, but I'm not 100% sure it is ok. So far my tests were OK (for some reason, my main testing bitcoins db was clear of any obfuscation). Could you pull the source again from https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) and rebuild it to try it ? It would be really helpful. Your new commit made it possible. Thanks. It's working fine now :) Is anyone insterested in downloading the CSV file? I can upload it to internet if anyone is insterested. Title: Re: Get list of all addresses with a balance over x? Post by: phucthinh11061997 on February 20, 2018, 01:59:31 PM Who knows if the balances_498754.csv file shared above contains the compressed or uncompressed format of the bitcoin public address?
Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on February 20, 2018, 04:42:03 PM Who knows if the balances_498754.csv file shared above contains the compressed or uncompressed format of the bitcoin public address? It is impossible to know if a bitcoin address is made using a compressed or uncompressed public key. Every bitcoin address has many compressed and uncompressed public keys that will generate that address. There are 2^160 possible addresses and 2^256 public keys, which makes about 2^96 different keys for each address But you can make an educated guess based on the date when the address was created. During the last 3-4 years >99% of generated addresses would use compressed public keys. And the oldest ones would probably use uncompressed keys. The only way to be certain is if there is a spend action from that address. then you can look at the published public key and you will know if it is compressed or not. Title: Re: Get list of all addresses with a balance over x? Post by: RebeccaCole on February 26, 2018, 11:36:03 AM Can't you just sort the output?
Title: Re: Get list of all addresses with a balance over x? Post by: rustychainz on March 03, 2018, 01:44:36 AM anyone have an updated file? balances_498754.zip is quite old.
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 04, 2018, 06:50:58 PM I've generated a new dump for all balances as of today.
Enjoy: https://transfer.sh/12aVfO/balances_20180304.out.gz Cheers. Title: Re: Get list of all addresses with a balance over x? Post by: P. on March 05, 2018, 12:49:44 PM Need to ask .. as second and third values are
1111111111111111111114oLvT2;43338925513 111111111111111111112BEH2ro;10940 if I check via bitref (or any other tool), second key balance is 65.57999243 third 0.00010940 seems like greater numbers are flawed somehow? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 05, 2018, 02:45:08 PM Need to ask .. as second and third values are 1111111111111111111114oLvT2;43338925513 111111111111111111112BEH2ro;10940 if I check via bitref (or any other tool), second key balance is 65.57999243 third 0.00010940 seems like greater numbers are flawed somehow? You picked a unusable address (ripemd160 hash is 0x0000000000..., that's just lost coins) with more than 50000 utxos attached to it (I count 52057 utxos while blockchain.info only count 51302). Honestly, it will be hard to debug this one, as I don't know how blockchain.info fills its database. By the way, I don't think there is a problem with big numbers. Other balances seems ok: Code: $ grep 1111116d87CjjDyP8SF5v1LTvUq22VFg balances.out Another sample: Code: $ grep 336xGpGweq1wtY4kRTuA4w6d7yDkBU9czU balances.out Cheers Title: Re: Get list of all addresses with a balance over x? Post by: P. on March 06, 2018, 08:24:28 AM Thanks for explanation.
Another one is .. there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean? T. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 06, 2018, 09:01:29 AM Thanks for explanation. Another one is .. there is one address that begins with 0e0 and few thousands of those starting with bc1. What does those mean? T. The 0e0 thing is something I didn't remove from output, and this is the obfuscation key of my database, and not an address. You can ignore it. The bc1 addresses are bech32 addresses (https://en.bitcoin.it/wiki/Bech32), introduced last year for segwit transactions. They are used in P2WPKH & P2WSH transactions. Cheers. Title: Re: Get list of all addresses with a balance over x? Post by: SoliDCoiNs on March 07, 2018, 01:47:29 PM Maybe someone has already done this and would like to share their results?
I think all of us would appreciate the effort! Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: erajaykumarrana on March 13, 2018, 11:26:04 AM I've generated a new dump for all balances as of today. Enjoy: https://transfer.sh/12aVfO/balances_20180304.out.gz Cheers. friend can you tell me how you generated this list, I have to generate it for dash coin.... I have seen your code on github... how can i compile it in visual studio 2017 on windows do you parse chain state directory... Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 14, 2018, 06:17:37 AM friend can you tell me how you generated this list, I have to generate it for dash coin.... I have seen your code on github... how can i compile it in visual studio 2017 on windows do you parse chain state directory... I've used this tool https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) I worked on as you know, using Bitcoin Core 0.15.1's updated chainstate, on Linux. Unfortunately, I've a bad news for you... First, I've no knowledge in Visual Studio and I'm pretty much sure you'll need to update the code a lot to make it compile. The good news is that dashcore also merged the new chainstate db format (https://github.com/bitcoin/bitcoin/pull/10195 (https://github.com/bitcoin/bitcoin/pull/10195)) I'm parsing, so it would be possible that this tool works correctly against dashcore! Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 16, 2018, 10:41:53 AM New dump for all bitcoin balances, as of today: balances.out.gz (https://transfer.sh/wzakh/balances.out.gz)
I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day ! Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 16, 2018, 10:49:21 AM Thank you very much. so, i guess your chainstate parser still works?
btw, every balance is matter, even it equals 1 satoshi. :) file is not too big. it easily opens on a good pc. Title: Re: Get list of all addresses with a balance over x? Post by: LeonsBTT on March 16, 2018, 02:15:10 PM What if a person has more than 1 account?
I mean what is the value of these files? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 16, 2018, 02:17:13 PM Thank you very much. so, i guess your chainstate parser still works? Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort. btw, every balance is matter, even it equals 1 satoshi. :) file is not too big. it easily opens on a good pc. This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this. Cheers. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 16, 2018, 02:19:41 PM What if a person has more than 1 account? I mean what is the value of these files? Nobody can regroup all addresses of a single wallet. If you don't value this information, you're free to not download it. :) Title: Re: Get list of all addresses with a balance over x? Post by: LeonsBTT on March 16, 2018, 02:23:40 PM What if a person has more than 1 account? I mean what is the value of these files? Nobody can regroup all addresses of a single wallet. If you don't value this information, you're free to not download it. :) What I mean is that if I am a whale that hold 10% of total bitcoins for me it is very easy to have different accounts, adresses etc and divide my coins between them. In other words, What conclusions do you want to get using this data? Do you think that they will be reliable? Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 16, 2018, 02:40:43 PM Thank you very much. so, i guess your chainstate parser still works? Yup, it works great and until Bitcoin Core changes its internal db format, it will continue to work. It only takes a few minutes to generate & sort. btw, every balance is matter, even it equals 1 satoshi. :) file is not too big. it easily opens on a good pc. This is not a file size problem, but a bandwidth problem. As for now, I'm using a "free" service, but I would rather host it on my own server, but BW is expensive for free stuff like this. Cheers. A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour. Can you share with me your chainstate parser? Wanna try it. Thanks. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 16, 2018, 02:58:41 PM A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour. Can you share with me your chainstate parser? Wanna try it. Thanks. The source code is opensource, on github: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory (https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory) The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all). Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 16, 2018, 03:02:30 PM A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour. Can you share with me your chainstate parser? Wanna try it. Thanks. The source code is opensource, on github: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory (https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory) The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all). Understood. Will try it on my dual xeon server. Title: Re: Get list of all addresses with a balance over x? Post by: dxlmz01 on March 16, 2018, 08:04:11 PM New dump for all bitcoin balances, as of today: balances.out.gz (https://transfer.sh/wzakh/balances.out.gz) I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day ! Thanks alot, I appreciate all the effort you're putting into this thread can i ask for a favor ? if its not too much to ask, of course ... I need a dump of addresses with balances until block #337000, not further. can you find some spare time in your schedule to provide that ? I will be very thankful. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 16, 2018, 09:32:02 PM New dump for all bitcoin balances, as of today: balances.out.gz (https://transfer.sh/wzakh/balances.out.gz) I think I'll remove small balances in the next version of this dump, as this file is really big and there are way too much really small wallets. Have a nice day ! Thanks alot, I appreciate all the effort you're putting into this thread can i ask for a favor ? if its not too much to ask, of course ... I need a dump of addresses with balances until block #337000, not further. can you find some spare time in your schedule to provide that ? I will be very thankful. I can do this, but it would require a little work. Can you send me a PM about this (can't send you one, you're blocking messages from newbies like me ;) ) ? Title: Re: Get list of all addresses with a balance over x? Post by: dinhbiplus on March 18, 2018, 09:03:36 PM Can't you just sort the output?
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 18, 2018, 09:19:48 PM Can't you just sort the output? I think I could do this. Mind to submit a patch ? Title: Re: Get list of all addresses with a balance over x? Post by: erajaykumarrana on March 19, 2018, 09:42:54 AM A few minutes? Whole core? That's really fast. When i tried to parse it with old "blockparser" i have 20% in 2 days and time was increased very fast every hour. Can you share with me your chainstate parser? Wanna try it. Thanks. The source code is opensource, on github: https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) It doesn't parse the blockchain. It just read the chainstate from Bitcoin Core. https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory (https://en.bitcoin.it/wiki/Data_directory#chainstate_subdirectory) The chainstate is the result of parsing the blockchain, and contains all unspent transactions for new transaction validation purposes. When a new block is recieved by Bitcoin core, it will update this database to remove spent transactions and fills in new unspent transactions. As for now, the chainstate is a 3-4GB leveldb database, with ~35 millions records (I didn't check recently). My tool will just read this database, and for each record (which are unspent transactions), decode it and find out which is the address & value (unspent amount of bitcoin). Then, with a set of scripts, I sort unique addresses & compute their final balance. The whole process takes ~ 10 minutes (and it is not optimized at all). I think I could do this. Mind to submit a patch ? [/quote] frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux.... I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make.... can you please PM me(I cant send you message as u block newbie....).... Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses.... Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 19, 2018, 09:57:19 AM frnd... can you please tell me the dependancy package to compile your softwre in ubuntu linux.... I have fresh install of linux ubuntu.... but there are so many errors when I tried to compile it using make.... can you please PM me(I cant send you message as u block newbie....).... Please help me, i Need all the unspent addresses of many coins.... i dont need balance I just need addresses.... I've sent you a PM with my email address so you can communicate privately, if you need to. Which coins will you this information ? The chainstate software is tied to Bitcoin Core (0.15+)'s chainstate format. If dash (or any other coin) is not using the same format, it won't work. Note that Bitcoin Core implemented this format in April last year, so it is most likely this software won't work. I could take a look at DASH, it would require me a few days however. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 19, 2018, 11:49:54 AM I could take a look at DASH, it would require me a few days however. Ok, I was able to extract all current balances for Dash. Have fun with this: https://transfer.sh/109sSU/balances.dash.out.gz Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 20, 2018, 02:27:48 AM I could take a look at DASH, it would require me a few days however. Ok, I was able to extract all current balances for Dash. Have fun with this: https://transfer.sh/109sSU/balances.dash.out.gz starmyc, your chainstate parser can make all transactions db ? Or maybe you already have one? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 20, 2018, 05:29:24 AM starmyc, your chainstate parser can make all transactions db ? Or maybe you already have one? The chainstate DB in Bitcoin Core only list the unspent transactions outputs (not even full transactions). So, answer is no, it can't. If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). Do you need something in particular ? Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 20, 2018, 07:25:14 AM starmyc, your chainstate parser can make all transactions db ? Or maybe you already have one? The chainstate DB in Bitcoin Core only list the unspent transactions outputs (not even full transactions). So, answer is no, it can't. If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). Do you need something in particular ? Yes, you right. I mean all unspent transactions, of course. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on March 20, 2018, 07:31:20 AM starmyc, your chainstate parser can make all transactions db ? Or maybe you already have one? The chainstate DB in Bitcoin Core only list the unspent transactions outputs (not even full transactions). So, answer is no, it can't. If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). Do you need something in particular ? Yes, you right. I mean all unspent transactions, of course. The chainstate parser I wrote works fine with Bitcoin Core & Dash databases, as I tested them. It should work with Litecoin too. I didn't test any other chains. If you need a dump for a particular chain, feel free to ask and I may work on it in exchange of a small donation. Title: Re: Get list of all addresses with a balance over x? Post by: bigman3912 on March 20, 2018, 07:41:18 AM starmyc, your chainstate parser can make all transactions db ? Or maybe you already have one? The chainstate DB in Bitcoin Core only list the unspent transactions outputs (not even full transactions). So, answer is no, it can't. If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). Do you need something in particular ? Yes, you right. I mean all unspent transactions, of course. The chainstate parser I wrote works fine with Bitcoin Core & Dash databases, as I tested them. It should work with Litecoin too. I didn't test any other chains. If you need a dump for a particular chain, feel free to ask and I may work on it in exchange of a small donation. Can we talk privately? If you PM me, it would be great. Title: Re: Get list of all addresses with a balance over x? Post by: guillzini on April 03, 2018, 08:03:24 PM This is good stuff, thanks for the effort!
Is there a link to the most recent dump? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 04, 2018, 06:58:05 AM This is good stuff, thanks for the effort! Is there a link to the most recent dump? Here is an excerpt of current balances (https://transfer.sh/5vujT/balances.top500.20180404.out). Title: Re: Get list of all addresses with a balance over x? Post by: guillzini on April 04, 2018, 12:23:40 PM This is good stuff, thanks for the effort! Is there a link to the most recent dump? Here is an excerpt of current balances (https://transfer.sh/5vujT/balances.top500.20180404.out). Thanks for your quick response! Could you please also share whenever you have a full list again? Thanks again Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 04, 2018, 02:00:40 PM I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address. Sure it is possible. You can find them all on this website, with associated private keys (http://www.allprivatekeys.com/allprivatekeys.php). Have fun! Title: Re: Get list of all addresses with a balance over x? Post by: guillzini on April 04, 2018, 06:48:22 PM I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address. Sure it is possible. You can find them all on this website, with associated private keys (http://www.allprivatekeys.com/allprivatekeys.php). Have fun! Depending on what you want to do, you can have a lot of fun with that :D I didn't mean to ask you something crazy or impossible. I saw you sharing output files of current balances in the thread before, but all those links are dead now. I also noticed you were thinking about removing small balances from the list. What I meant to ask is if you come around outputting that list, if you could share it here as well :) In any case, I appreciate the time you put into this! Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 04, 2018, 07:37:41 PM Depending on what you want to do, you can have a lot of fun with that :D I didn't mean to ask you something crazy or impossible. I saw you sharing output files of current balances in the thread before, but all those links are dead now. I also noticed you were thinking about removing small balances from the list. What I meant to ask is if you come around outputting that list, if you could share it here as well :) In any case, I appreciate the time you put into this! Processing the whole stuff is taking too much of my time, and unfortunately I'm very busy. I think this is one of the last time I'll create it: Here is the full list (https://transfer.sh/xTxCm/balances.20180404.out.gz). Enjoy it. :) Title: Re: Get list of all addresses with a balance over x? Post by: guillzini on April 05, 2018, 09:23:50 AM Depending on what you want to do, you can have a lot of fun with that :D I didn't mean to ask you something crazy or impossible. I saw you sharing output files of current balances in the thread before, but all those links are dead now. I also noticed you were thinking about removing small balances from the list. What I meant to ask is if you come around outputting that list, if you could share it here as well :) In any case, I appreciate the time you put into this! Processing the whole stuff is taking too much of my time, and unfortunately I'm very busy. I think this is one of the last time I'll create it: Here is the full list (https://transfer.sh/xTxCm/balances.20180404.out.gz). Enjoy it. :) Thank you very much. I appreciate it :) Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on April 05, 2018, 10:49:51 AM In any case, I appreciate the time you put into this! Processing the whole stuff is taking too much of my time, and unfortunately I'm very busy. I think this is one of the last time I'll create it: Here is the full list (https://transfer.sh/xTxCm/balances.20180404.out.gz). Enjoy it. :) Thanks for the new list :) Sad to hear, that you are planning to stop making new ones. Hope it is not the data upload costs that affect your decision. For me it would be enough to get list of addresses containing 1BTC or more. That list is about 30Mb in size. And even those would not need to be updated very often. Maybe once in 4 to 6 months. But that is just me. And as you have published your source code, others can keep doing the same :) I am probably going to install your program to be able to do it myself, but for that I will need a full node, and that is a bit complicated with my hardware currently... Title: Re: Get list of all addresses with a balance over x? Post by: faultunfmuzzled8 on April 09, 2018, 01:19:31 AM It means you simple want to import blockchain in a CSV file isnt it? Thats possible but tough though
Title: Re: Get list of all addresses with a balance over x? Post by: Ryannnnnnn on April 09, 2018, 04:30:10 AM I would also be interested in an up-to-date list of all addresses with balance. No sites I have found provide this service.
Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on April 09, 2018, 11:56:49 AM It means you simple want to import blockchain in a CSV file isnt it? Thats possible but tough though Starmyc released his program that can do just that, but you need to have a full node.Post please the current address list with balances. I would also be interested in an up-to-date list of all addresses with balance. No sites I have found provide this service. Have you guys read this topic at all? Starmyc has just posted (on 4th of April) a link to a file with a list of all addresses with balances from the same day. And that is exactly what you are asking. Are you seriously saying that 6 days old info is not recent enough? If you are not generating the list yourself, you are very lucky if you get a list that is from the same YEAR. So be grateful and give merit to him, if you download :) Title: Re: Get list of all addresses with a balance over x? Post by: LoyceV on April 09, 2018, 02:10:15 PM Processing the whole stuff is taking too much of my time, and unfortunately I'm very busy. I think this is one of the last time I'll create it: Here is the full list (https://transfer.sh/xTxCm/balances.20180404.out.gz). Enjoy it. :) I tried to download it, but it's slow and failed several times. I would have liked to keep a copy.It would be nice if you can keep this up, but less frequent? If you make a complete list of all addresses and their balance once every few months instead of weekly it saves you a lot of time, and still offers fairly recent data. Title: Re: Get list of all addresses with a balance over x? Post by: LovellaSai on April 11, 2018, 08:43:25 PM I have personally used ABE but it takes 2-3 months in doing so starting from Block 0, but is full proof no doubt
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 11, 2018, 08:49:02 PM Processing the whole stuff is taking too much of my time, and unfortunately I'm very busy. I think this is one of the last time I'll create it: Here is the full list (https://transfer.sh/xTxCm/balances.20180404.out.gz). Enjoy it. :) I tried to download it, but it's slow and failed several times. I would have liked to keep a copy.It would be nice if you can keep this up, but less frequent? If you make a complete list of all addresses and their balance once every few months instead of weekly it saves you a lot of time, and still offers fairly recent data. The truth is it doesn't take me a lot of time to generate it. The time is spent uploading to my server. And the main problem is that quality bandwidth costs money, and well, some people helped me but still! I'm still looking for a solution to automatize all this and that satisfies me. Title: Re: Get list of all addresses with a balance over x? Post by: LoyceV on April 11, 2018, 09:01:43 PM The truth is it doesn't take me a lot of time to generate it. The time is spent uploading to my server. And the main problem is that quality bandwidth costs money, and well, some people helped me but still! I'm quite satisfied with 000webhostapp.com, although the free hosting can fit your file only once. I can use CLI to upload/FTP files from within a script.I'm still looking for a solution to automatize all this and that satisfies me. I haven't tried it, but 🚀 BitcoinTalk's FREE Web Host 🚀 [🔥 EXCLUSIVE 🔥] (Scalable) 2GB Disk (https://bitcointalk.org/index.php?topic=2830067.0) could be an option for you too. Title: Re: Get list of all addresses with a balance over x? Post by: saberibm3 on April 14, 2018, 10:27:15 PM Blockparser is an excellent sorter but surely it needs greater RAM linux box
Title: Re: Get list of all addresses with a balance over x? Post by: kajin on April 15, 2018, 05:25:21 AM I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.
This is the closest thing I see already built but its for project's wallets. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 15, 2018, 03:13:49 PM Blockparser is an excellent sorter but surely it needs greater RAM linux box What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk... Bottleneck is mostly CPU and I/O, not memory. I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding. This is the closest thing I see already built but its for project's wallets. This is something that is really trivial to do (even for ERC20 tokens). Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 19, 2018, 08:38:01 PM For people interested, enjoy today's dump: http://bit.ly/2vqsDPX
Title: Re: Get list of all addresses with a balance over x? Post by: guillzini on April 20, 2018, 08:12:02 AM For people interested, enjoy today's dump: http://bit.ly/2vqsDPX Thank you for sharing once again! Much appreciated :) Title: Re: Get list of all addresses with a balance over x? Post by: btc-room101 on April 20, 2018, 09:51:15 AM I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding. This is the closest thing I see already built but its for project's wallets. I have all these addresses for ethereum and bitcoin, all sorted by files of 500k satoshi, 1m, and 10m, but these files are 10gb+ Same for ethereum files Somebody have an idea of how to upload this data for free? and keep up there for free? I wrote a new website that talks about these tools, getting the data is easy, sorting it, and running the processes every 10 minutes is the real work, not much use if the data 'old' in a few days inflection.top inflection@proton.com, give me some hints about how to get this data up, and if you want the ethereum first that's fine, I got the data, and don't use it much, mostly focus on the better stuff, and I don't consider ether that useful, I think after running 'brain-flayer' for months on eth I found TWO brain-wallets, compare that to btc, where there are +100k, but only 2k had value, and its long gone Title: Re: Get list of all addresses with a balance over x? Post by: btc-room101 on April 20, 2018, 09:57:58 AM Blockparser is an excellent sorter but surely it needs greater RAM linux box What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk... Bottleneck is mostly CPU and I/O, not memory. I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding. This is the closest thing I see already built but its for project's wallets. This is something that is really trivial to do (even for ERC20 tokens). Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing. well you really don't use the 'data' per se, once you have the data you put it into bloom-filters (blf) files, but I use +16gb bloom's, not the 512mb stuff found on brain-flayer, then when you have super large lists like all the btc-addresses ever used, you need to use TRIES on these 32gb files, as searching in the unsorted/unprocessed file is impossible, which are binary sorted files, but super fast because they use binary search but again, the data is not much use, once you have it stored as bloom and trie for all the addresses, then there is no reason to ever work with the raw lists again the only case where I think its useful to keep 'lists' is for the public-key/private-key pairs, and their hash160 values, so that if you ever do find a HOT 'hash', you need to be able to map it back to that private-key you found ... Again you can't really work with these lists of addresses because its too slow to work on a 16gb file and use grep or sort to inquire Title: Re: Get list of all addresses with a balance over x? Post by: btc-room101 on April 20, 2018, 10:08:20 AM Blockparser is an excellent sorter but surely it needs greater RAM linux box It hasn't been maintained for 4+ years, It worked when the block chain was 10gb, and less than 100k blocks, but now at over 500k blocks it just breaks at around +400k no matter how much memory you have, besides its slow, it takes days just to get to 400k, then it dies, its not easy to maintain software There are dozens of these 'block-parsers' on GITHUB , but they have all been abandoned, even the few that 'work' don't really work, they usually break, because BTC keeps inventing new stuff on the block-chain, and the hex-decoders just abort when they see something they don't understand, I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or 10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff, Personally I think the pristine ( satoshi's coins ), and high-value public-key stuff is the real "GOLD" in this game. The average BTC used, is less than 0.05BTC of value, hardly worth the effort, even if its a random hit. inflection.com Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 20, 2018, 12:03:39 PM I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or 10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff, What about sharing the code ? I would be more interested on code than on the result. Title: Re: Get list of all addresses with a balance over x? Post by: xraisers on April 21, 2018, 07:04:51 PM I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 21, 2018, 07:24:25 PM I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address. Déja vu feeling.Strangely, I've already replied this sooner with week, before the original message got moderated. If your papier wallet received coins, the information is stored in the blockchain, and we know the address balance. If it doesn't, then we also know the balance, it is 0. In fact, we really don't care about the address type: paper wallet, hardware wallet, etc, an address is just an address, and they all work the same. Title: Re: Get list of all addresses with a balance over x? Post by: denish on April 26, 2018, 04:23:21 PM For people interested, enjoy today's dump: http://bit.ly/2vqsDPX Hello! The file is not available anymore :( Do you have another version? :) Thanks! Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 27, 2018, 11:26:04 AM For people interested, enjoy today's dump: http://bit.ly/2vqsDPX Hello! The file is not available anymore :( Do you have another version? :) Thanks! Yes, and this will be the last time I'll share it. Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it. Bonus points: - The LTC dump: http://bit.ly/LtcBalances20180427 - The Dash dump: http://bit.ly/DashBalances20180427 Edit: Sorry, links are now down ! Have a nice day! Title: Re: Get list of all addresses with a balance over x? Post by: denish on April 27, 2018, 02:45:12 PM For people interested, enjoy today's dump: http://bit.ly/2vqsDPX Hello! The file is not available anymore :( Do you have another version? :) Thanks! Yes, and this will be the last time I'll share it. Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it. The link is: http://bit.ly/BtcBalances20180427 Bonus points: - The LTC dump: http://bit.ly/LtcBalances20180427 - The Dash dump: http://bit.ly/DashBalances20180427 Have a nice day! Thank you very much :) Title: Re: Get list of all addresses with a balance over x? Post by: denish on April 27, 2018, 04:17:35 PM Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string".
What is the "format" of these public keys in your file? :) Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on April 27, 2018, 07:06:17 PM Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string". What is the "format" of these public keys in your file? :) It works fine to me: Code: >>> import base58 Or with bitcoin-tool: Code: ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg --input-type address --input-format base58check --output-type all bitcoin-tool does a checksum check. With an invalid address: Code: $ ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmh --input-type address --input-format base58check --output-type all I do not know your library, but I would take a look at it first. Title: Re: Get list of all addresses with a balance over x? Post by: tmy on May 12, 2018, 08:24:02 AM Can anyone share BTCbalance file as all links are dead?
Thanks Title: Re: Get list of all addresses with a balance over x? Post by: hatuey on May 13, 2018, 03:41:03 AM All links are dead. could anyone share a copy or a recent dump? :(
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on May 13, 2018, 03:11:27 PM Can anyone share BTCbalance file as all links are dead? Thanks All links are dead. could anyone share a copy or a recent dump? :( Hi everyone, Since I've got multiple private messages for generating new dumps, I've decided to wrote a small web service to automatize the whole chain, and it is now available online, at this address: https://balances.syndevio.com/ I came to that decision seeing that each dump I provided so far was downloaded more than an hundred times and well, bandwidth (and my time) is not free. For a few dust, the service makes links available to everyone for 3 days: You'll pay for my servers & the community. I also plan to add more coins in the future. I know my tools are compatible with dash, and I'm pretty sure all bitcoin/litecoin forks would work too. Just contact me if you want more information. :) And for people who doesn't want to pay (and I understand them), my tools - and alternatives - were already open-sourced (links are somewhere in this topic)! And for people I already made business with in the past, dumps are still free ! (I'll give you links on private request, as always). Title: Re: Get list of all addresses with a balance over x? Post by: AnnSerg77 on May 13, 2018, 07:59:03 PM I think... Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances and filter out the ones? Title: Re: Get list of all addresses with a balance over x? Post by: DavidBloom_NY on May 14, 2018, 06:55:24 AM in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty ;) Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse newbie here, this works, thanks a lot. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on May 14, 2018, 07:05:36 AM in short: - get a Linux Box/VM with >=8GB RAM - download blockparser - compile it - run "./parser allBalances -w 250000 >allBalances.txt" the parser run take around 2 minutes on my vSphere VM (2x3Ghz Xeon, 16GB of RAM) now you have a list of the top 250.000 adresses sorted by BTC amount. add some sed/awk/cut magic to make a csv and you are done. not as easy for the avg windows joe but not that hard either... quick'n'dirty ;) Edit: ofc you need a up-to-date blockchain in <user>/.bitcoin for it to parse newbie here, this works, thanks a lot. Yeah, well, I'm interested on which version of blockparser you used, because the 1st link given by google is https://github.com/znort987/blockparser, and as last change was 3 years ago, I can safely say it doesn't include segwit transactions, bech32 addresses... :) Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on May 22, 2018, 08:43:42 AM Hello!
Can you parse Bitcoin Private (btcprivate.org)? Title: Re: Get list of all addresses with a balance over x? Post by: QRC on May 24, 2018, 05:15:57 AM Hello! You can parse almost any coin very easily, because most of them using level db for keeping their utxo, Can you parse Bitcoin Private (btcprivate.org)? Just use python plyvel module to read db data. Actually, bitcoin private used the same technique to get bitcoin utxo. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on May 24, 2018, 05:23:11 AM Hello! You can parse almost any coin very easily, because most of them using level db for keeping their utxo, Can you parse Bitcoin Private (btcprivate.org)? Just use python plyvel module to read db data. Actually, bitcoin private used the same technique to get bitcoin utxo. Yes, but this is not sufficient. You also have to uncompress those entries, and it requires some programming knowledge than using a library and print, it requires too to know how those coins works, their storage format (compact size, varint, etc)... Not hard, not trivial either. Hello! Can you parse Bitcoin Private (btcprivate.org)? I've added Zcash & Bitcoin Private balances generation to my webservice (https://balances.syndevio.com). I've still a little work to do on my software though. Title: Re: Get list of all addresses with a balance over x? Post by: QRC on May 24, 2018, 05:44:36 AM Yes, but this is not sufficient. You also have to uncompress those entries, and it requires some programming knowledge than using a library and print, it requires too to know how those coins works, their storage format (compact size, varint, etc)... Not hard, not trivial either. Yes, it's true. However, if coin uses bitcoin codebase from 0.15 or later, it's quiet easy, one db entry one utxo. Before that it's somewhat complicated because one db entry contained the whole transaction. But format of this entry was well documented in coin.h file: https://github.com/bitcoin/bitcoin/blob/v0.10.1/src/coins.h#L20 (https://github.com/bitcoin/bitcoin/blob/v0.10.1/src/coins.h#L20) Also, if I'm not mistaken BTCP script has function for decoding old format as well https://github.com/BTCPrivate/utxo-dump/blob/master/utxo/chainstate.py (https://github.com/BTCPrivate/utxo-dump/blob/master/utxo/chainstate.py) parse_ldb_value_old line 57 Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on May 24, 2018, 07:24:28 AM Also, if I'm not mistaken BTCP script has function for decoding old format as well https://github.com/BTCPrivate/utxo-dump/blob/master/utxo/chainstate.py (https://github.com/BTCPrivate/utxo-dump/blob/master/utxo/chainstate.py) parse_ldb_value_old line 57 But you're spoiling all fun to learn. It is more interesting to code your own decoder to learn how it structured & how things work. Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on May 28, 2018, 11:25:55 AM Can you parse MoneroV (XMV) blockchain? monerov.org
And Reden (REDN) interesting too :) reden.io Title: Re: Get list of all addresses with a balance over x? Post by: MikaelBlomvist on May 30, 2018, 07:39:38 PM need this but my vps has 40GB of space, cant fit those damn blocks there ;D. Any other solution!?
Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on June 01, 2018, 06:10:00 AM @starmyc, can you tell, you use https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) to parse chainstate db? Or you work with full blockchain database?
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 01, 2018, 06:14:06 AM @starmyc, can you tell, you use https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) to parse chainstate db? Or you work with full blockchain database? Sure I use it (as I wrote it). Parsing the whole blockchain is slow, I let this job to official clients. Title: Re: Get list of all addresses with a balance over x? Post by: Banxter on June 01, 2018, 06:38:39 AM @starmyc, can you tell, you use https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) to parse chainstate db? Or you work with full blockchain database? Sure I use it (as I wrote it). Parsing the whole blockchain is slow, I let this job to official clients. How much does this parser use RAM? (the old parser https://github.com/znort987/blockparser was good, but I used at least 64GB, I had to use expensive VPS) Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 01, 2018, 07:29:31 AM @starmyc, can you tell, you use https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) to parse chainstate db? Or you work with full blockchain database? Sure I use it (as I wrote it). Parsing the whole blockchain is slow, I let this job to official clients. How much does this parser use RAM? (the old parser https://github.com/znort987/blockparser was good, but I used at least 64GB, I had to use expensive VPS) The chainstate is not the blockchain. Those are 2 differents tools for 2 differents usages. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on June 01, 2018, 08:19:42 AM If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). @starmyc please can you share the link to download that closed-source blockparser? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 01, 2018, 08:47:58 AM If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). @starmyc please can you share the link to download that closed-source blockparser? I will, someday. Still need to clean up the really crappy code. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on June 02, 2018, 03:18:52 AM @starmyc is any idea for to make some cool stuff? Not only –Chainstate LDB API caller–. I made ldb files parser without of any APIs and third-parties frameworks. Only hardcore, only raw decoding.
P.S. Obfuscated keys are strong for unequipped user :) Title: Re: Get list of all addresses with a balance over x? Post by: Adsixnine on June 02, 2018, 10:54:31 AM I'm curious as to what % of possible addresses have been used? ???
Title: Re: Get list of all addresses with a balance over x? Post by: MikaelBlomvist on June 02, 2018, 04:06:31 PM I'm curious as to what % of possible addresses have been used? ??? considering the amount of bitcoin addresses that can be generated, I'd say we have used around 0.000000000001% Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 03, 2018, 08:30:42 PM I'm curious as to what % of possible addresses have been used? ??? considering the amount of bitcoin addresses that can be generated, I'd say we have used around 0.000000000001% FYI, today I've done a full dump of all bitcoin addresses ever used at least once. I've reached the number of 401,407,598 unique addresses for all block files from blk00000 to blk01275. The % is still really small. Smaller than 10^-40 %, at least. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 03, 2018, 08:35:25 PM @starmyc is any idea for to make some cool stuff? Not only –Chainstate LDB API caller–. I made ldb files parser without of any APIs and third-parties frameworks. Only hardcore, only raw decoding. P.S. Obfuscated keys are strong for unequipped user :) I do not parse ldb files by myself. I use google's library for this, as I want to focus more on Bitcoin's aspect rather than a third party nosql library (I would rather study cassandra or any distributed engine). What's the issue with obfuscated datas ? The key is in the DB as well! Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on June 04, 2018, 10:14:25 PM If you want to list all transactions from a blockchain, you need a block parser (and I've mine too, but it is closed source). @starmyc please can you share the link to download that closed-source blockparser? I will, someday. Still need to clean up the really crappy code. ??? Title: Re: Get list of all addresses with a balance over x? Post by: giftseller8x on June 05, 2018, 08:47:55 AM Can anyone share BTCbalance file as all links are dead? Thanks All links are dead. could anyone share a copy or a recent dump? :( Hi everyone, Since I've got multiple private messages for generating new dumps, I've decided to wrote a small web service to automatize the whole chain, and it is now available online, at this address: https://balances.syndevio.com/ I came to that decision seeing that each dump I provided so far was downloaded more than an hundred times and well, bandwidth (and my time) is not free. For a few dust, the service makes links available to everyone for 3 days: You'll pay for my servers & the community. I also plan to add more coins in the future. I know my tools are compatible with dash, and I'm pretty sure all bitcoin/litecoin forks would work too. Just contact me if you want more information. :) And for people who doesn't want to pay (and I understand them), my tools - and alternatives - were already open-sourced (links are somewhere in this topic)! And for people I already made business with in the past, dumps are still free ! (I'll give you links on private request, as always). P/S: I cannot build your tool on Ubuntu 16.04 so I have to download your dump file. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 05, 2018, 08:49:45 AM P/S: I cannot build your tool on Ubuntu 16.04 so I have to download your dump file. I work on Fedora/Centos environments. Ubuntu 16.04 is a little old, but it should compile & work. What are errors? Can you please raise an issue on github? Title: Re: Get list of all addresses with a balance over x? Post by: giftseller8x on June 05, 2018, 10:06:12 AM P/S: I cannot build your tool on Ubuntu 16.04 so I have to download your dump file. I work on Fedora/Centos environments. Ubuntu 16.04 is a little old, but it should compile & work. What are errors? Can you please raise an issue on github? More install instruction is help. https://github.com/mycroft/chainstate/issues/3 Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 07, 2018, 07:47:48 PM P/S: I cannot build your tool on Ubuntu 16.04 so I have to download your dump file. I work on Fedora/Centos environments. Ubuntu 16.04 is a little old, but it should compile & work. What are errors? Can you please raise an issue on github? More install instruction is help. https://github.com/mycroft/chainstate/issues/3 Latest works fine. Just built current tree on centos 7.5.1804. yum install leveldb-devel (centos/fedora) and apt install libleveldb-dev (debian/ubuntu) is sufficient for leveldb. Title: Re: Get list of all addresses with a balance over x? Post by: Banxter on June 07, 2018, 08:09:55 PM FYI, today I've done a full dump of all bitcoin addresses ever used at least once. I've reached the number of 401,407,598 unique addresses for all block files from blk00000 to blk01275. The % is still really small. Smaller than 10^-40 %, at least. can you post this entire archive on your website for download?Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 08, 2018, 05:44:34 AM FYI, today I've done a full dump of all bitcoin addresses ever used at least once. I've reached the number of 401,407,598 unique addresses for all block files from blk00000 to blk01275. The % is still really small. Smaller than 10^-40 %, at least. can you post this entire archive on your website for download?Sorry, because they are too much space consuming, I do not offer those. Title: Re: Get list of all addresses with a balance over x? Post by: 3dkevin on June 09, 2018, 09:33:23 AM Sorry, because they are too much space consuming, I do not offer those. zip it, make torrent! ..we really need all address even with zero bal. or help to do it myself Title: Re: Get list of all addresses with a balance over x? Post by: 3dkevin on June 09, 2018, 10:38:11 AM please post fresh (this year) bitcoin dump for free
all previous links are dead Title: Re: Get list of all addresses with a balance over x? Post by: noobCyptoBot on June 10, 2018, 02:42:12 AM hi starmyc, I notice that there are some address with zero balance in the compressed file you upload. If those are from utxos why it have zero balance? just want to know something weird
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 10, 2018, 06:00:12 AM hi starmyc, I notice that there are some address with zero balance in the compressed file you upload. If those are from utxos why it have zero balance? just want to know something weird Yes, there is a bunch of utxos with addresses receiving exactly 0 btc, like in ceb1a7fb57ef8b75ac59b56dd859d5cb3ab5c31168aa55eb3819cd5ddbd3d806 (https://blockchain.info/fr/tx/ceb1a7fb57ef8b75ac59b56dd859d5cb3ab5c31168aa55eb3819cd5ddbd3d806) or 84a5b3ff691210a0a026db9dd9f3d9a70645d44a7ef82e7dc374ee4cc7c27bbc (https://blockchain.info/fr/tx/84a5b3ff691210a0a026db9dd9f3d9a70645d44a7ef82e7dc374ee4cc7c27bbc). Technically, I guess those are still spendable (with another inputs funding the fees), but it will be pretty much useless as it will cost more money that it will unlock... Title: Re: Get list of all addresses with a balance over x? Post by: 3dkevin on June 11, 2018, 10:12:43 PM balances-bitcoin-20180611-0000: Size: 593129214
hi starmyc, what does size mean? bytes or adresses ? Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 12, 2018, 05:20:34 PM balances-bitcoin-20180611-0000: Size: 593129214 hi starmyc, what does size mean? bytes or adresses ? Nope, those are file size. Adding number of records is a nice idea, I'll think about it. There are currently 22.3 millions records actually in the bitcoin dump! Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on June 15, 2018, 11:33:56 AM Long long time ago, last fresh balance:
http://srv.keinbrot.com/download/balances_527280.zip This also includes all multisign outputs. Title: Re: Get list of all addresses with a balance over x? Post by: coder0x15 on June 16, 2018, 02:12:38 PM Someone share a standalone Python script that can parse whole raw blockchain data.
Here –> https://github.com/normanvolt/blockchain-parser (https://github.com/normanvolt/blockchain-parser) Check it. Title: Re: Get list of all addresses with a balance over x? Post by: Thirdspace on June 20, 2018, 11:22:02 PM I'm sorry, this might be slightly off topic
instead of using blockparser or querying online web block explorer, is there a way to get balance of a specific address without importing it first into the wallet? getreceivedbyaddress and getbalance seems to work only for addresses in local wallet :-\ Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 21, 2018, 05:08:40 PM I'm sorry, this might be slightly off topic instead of using blockparser or querying online web block explorer, is there a way to get balance of a specific address without importing it first into the wallet? getreceivedbyaddress and getbalance seems to work only for addresses in local wallet :-\ Unfortunately, there is no easy way to find out a balance for an address directly without parsing the whole chain. However, Bitcoin Core maintains an UTXO database called chainstate and as it is quite smaller than the blockchain, it is used to retrieve spendable outputs then the balance of an address. Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on June 24, 2018, 03:22:10 PM Hello, starmyc!
Thank you for your good job! Can you parse a BitcoinZ blockchain addresses? BitcoinZ have zhash algo (equihash 144 5). So interesting. https://github.com/bitcoinz-wallets/bitcoinz-copay-wallet/releases Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on June 24, 2018, 04:08:37 PM Sorry, because they are too much space consuming, I do not offer those. zip it, make torrent! ..we really need all address even with zero bal. or help to do it myself Here is a list of ALL ever used bitcoin address until 24.06.2018: http://srv.keinbrot.com/download/Bitcoin_AllAdressesEver_20180624.txt.torrent If you like it: download and help seeding ;) Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 24, 2018, 05:40:21 PM Hello, starmyc! Thank you for your good job! Can you parse a BitcoinZ blockchain addresses? BitcoinZ have zhash algo (equihash 144 5). So interesting. https://github.com/bitcoinz-wallets/bitcoinz-copay-wallet/releases Sure: https://balances.syndevio.com/balances/.balances-bitcoinz.txt You are welcome! Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on June 25, 2018, 09:35:48 AM Thank you, friend!
So scary balances on btcz.... Title: Re: Get list of all addresses with a balance over x? Post by: Banxter on June 25, 2018, 09:57:00 AM So scary balances on btcz.... make division by 100000000Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on June 27, 2018, 08:14:38 PM starmyc, can you share older files (may be yesterday's only) for free?
Sorry, i dont have now any donations :( Thank you anyway! Title: Re: Get list of all addresses with a balance over x? Post by: bro_roku on June 28, 2018, 07:26:11 PM Sorry, because they are too much space consuming, I do not offer those. zip it, make torrent! ..we really need all address even with zero bal. or help to do it myself Here is a list of ALL ever used bitcoin address until 24.06.2018: http://srv.keinbrot.com/download/Bitcoin_AllAdressesEver_20180624.txt.torrent If you like it: download and help seeding ;) Thanks for this daboehla. Any chance of a seed? Stuck at 0% right now. Title: Re: Get list of all addresses with a balance over x? Post by: daboehla on June 29, 2018, 04:37:52 AM Sorry, because they are too much space consuming, I do not offer those. zip it, make torrent! ..we really need all address even with zero bal. or help to do it myself Here is a list of ALL ever used bitcoin address until 24.06.2018: http://srv.keinbrot.com/download/Bitcoin_AllAdressesEver_20180624.txt.torrent If you like it: download and help seeding ;) Thanks for this daboehla. Any chance of a seed? Stuck at 0% right now. My utorrent is still seeding since start. I will check if I manage to upload it somewhere. Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on June 29, 2018, 01:26:24 PM starmyc, can you share older files (may be yesterday's only) for free? Sorry, i dont have now any donations :( Thank you anyway! Nope, sorry! Any chance of a seed? Stuck at 0% right now. If you need quickly an update export of all addresses, I create it & upload it everyday. :) Code: $ zcat all-up-to-1301.gz | wc -l Feel free to contact me for more information! Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on July 01, 2018, 12:17:19 PM Starmyc, how about Monero (XMR)?
Title: Re: Get list of all addresses with a balance over x? Post by: Banxter on July 01, 2018, 12:28:06 PM can anyone make a list Ethereum addresses?
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on July 01, 2018, 07:54:00 PM Starmyc, how about Monero (XMR)? Not planned for the moment... Monero is not a bitcoin fork, so it would require to reverse engineer bitmonero, and this is not something I've done yet. Title: Re: Get list of all addresses with a balance over x? Post by: KeenEdge on July 09, 2018, 11:33:48 PM Could anyone update and share for free BTC actual ballances list, please?
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on July 10, 2018, 12:21:26 PM Could anyone update and share for free BTC actual ballances list, please? Someone was kindly enough to unlock https://balances.syndevio.com/ for today! Feel free to quick download the balance file. Title: Re: Get list of all addresses with a balance over x? Post by: GreatBug on July 10, 2018, 11:59:54 PM there are a lot of ways to do that man.
Title: Re: Get list of all addresses with a balance over x? Post by: DryPalms on July 12, 2018, 04:37:26 AM Hello starmyc :)
First of all, thanks for a great software. But I am struggling to get it working. I am on CentOS 7 (7.5.1804) You stated earlier in this thread that yum install leveldb-devel will be enough to install LevelDB on my OS but I found that CentOS repos doesn't have that lib, so i searched and found it on epel repo. Running yum install leveldb-devel installed LevelDB 1.12.0 with headers. Then I installed chainstate with no errors, but when I try to run it I am getting this: Code: [xuser@power chainstate]$ time ./chainstate >/tmp/cs.output 2>/tmp/cs.errors And this: Code: [xuser@power chainstate]$ cat /tmp/cs.errors What am I doing wrong? Thank you for your help! Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on July 12, 2018, 06:20:16 AM And this: Code: [xuser@power chainstate]$ cat /tmp/cs.errors What am I doing wrong? Thank you for your help! Likely, the DB can't be opened for some reason. Did you correctly follow the required steps prior using this program ? Title: Re: Get list of all addresses with a balance over x? Post by: DryPalms on July 12, 2018, 08:20:20 AM And this: Code: [xuser@power chainstate]$ cat /tmp/cs.errors What am I doing wrong? Thank you for your help! Likely, the DB can't be opened for some reason. Did you correctly follow the required steps prior using this program ? I hope so. I have re-installed it two times from the scratch just now. Re-installed dependencies and even installed it under different user - same result. Can you please take a look at the install log? Here is it: https://pastebin.com/z7h6sdmD Anything suspicious? What additional info can I provide you with to identify/fix the problem? Thank you very much! Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on July 12, 2018, 08:35:30 AM And this: Code: [xuser@power chainstate]$ cat /tmp/cs.errors What am I doing wrong? Thank you for your help! Likely, the DB can't be opened for some reason. Did you correctly follow the required steps prior using this program ? I hope so. I have re-installed it two times from the scratch just now. Re-installed dependencies and even installed it under different user - same result. Can you please take a look at the install log? Here is it: https://pastebin.com/z7h6sdmD Anything suspicious? What additional info can I provide you with to identify/fix the problem? Thank you very much! Did you correctly stopped bitcoind before copying the state directory ? Title: Re: Get list of all addresses with a balance over x? Post by: DryPalms on July 12, 2018, 08:50:34 AM Did you correctly stopped bitcoind before copying the state directory ? Sure. Here is the script that stops my bitcoind. Is this correct stopping? Code: [suser@power ~]$ cat /home/suser/bitcoin-core/.bitcoin/stop.sh I stopped it before copying. I am using bitcoin core 0.16.0 Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on July 12, 2018, 09:02:41 AM Did you correctly stopped bitcoind before copying the state directory ? Sure. Here is the script that stops my bitcoind. Is this correct stopping? Code: [suser@power ~]$ cat /home/suser/bitcoin-core/.bitcoin/stop.sh I stopped it before copying. I am using bitcoin core 0.16.0 You must take care of waiting a few seconds before copying: bitcoind takes a few seconds to stop & correctly close the database. If you send the kill signal then directly copy the directory, it is possible the database is still marked as open and the leveldb library will refuse to open it, leading to the exception you're hitting. Please add a "sleep 15" after your kill, and check your bitcoind is really down. If that does not do it, the best I can do is to show the leveldb error message instead of the exception; It would give you an hint. I'll take a look about this tonight. Title: Re: Get list of all addresses with a balance over x? Post by: DryPalms on July 12, 2018, 09:23:01 AM You must take care of waiting a few seconds before copying: bitcoind takes a few seconds to stop & correctly close the database. If you send the kill signal then directly copy the directory, it is possible the database is still marked as open and the leveldb library will refuse to open it, leading to the exception you're hitting. Please add a "sleep 15" after your kill, and check your bitcoind is really down. If that does not do it, the best I can do is to show the leveldb error message instead of the exception; It would give you an hint. I'll take a look about this tonight. I have started the bitcoind, waited it to synchronize with network and then stopped via bitcoin-cli stop (this is the correct way as per docs). After a few minutes I copied chainstate and run your software - unfortunately, it still dying with the same error. So it seems like there some problem with leveldb library - maybe it is too old (1.12.0) and incompatible with bitcoin core 0.16.0 database. Ok I will be waiting and monitoring your git for the version which catches leveldb error. Thank you for your help. I appreciate it. Title: Re: Get list of all addresses with a balance over x? Post by: kirkarsedat on July 17, 2018, 08:52:06 PM I would recommend ABE, but with it, if you start importing from block 0, it might take a month or two to fully import the blockchain, unless of course you have an SSD and fast RAM
Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on August 02, 2018, 11:13:09 AM Hello, starmyc!
I add REDEN (https://github.com/RedenCore/Reden/blob/master/src/chainparams.cpp) { "reden", { 0x3c }, 1, { 0x10 }, 1 }, // Also uses 60, 16 But have error in cs.errors: using obfuscation key 6ae3411e08c3ee64 Record type 14 is not handled. Index: 0e006f62667573636174655f6b6579 Value: 086ae3411e08c3ee64 last block: 64eec3081c401b2fefce63148a8e8621edef23cac15154aa4d51a6714d95ddca terminate called after throwing an instance of 'std::out_of_range' what(): basic_string::substr: __pos (which is 1) > this->size() (which is 0) Title: Re: Get list of all addresses with a balance over x? Post by: champion357 on August 17, 2018, 08:54:37 AM yes please. Does someone have a current list?
Title: Re: Get list of all addresses with a balance over x? Post by: champion357 on August 17, 2018, 09:04:36 AM can someone post a link to the new list?
Title: Re: Get list of all addresses with a balance over x? Post by: TheArchaeologist on August 17, 2018, 09:56:21 AM can someone post a link to the new list? There isn't any. You could build it yourself though.Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on August 17, 2018, 09:57:57 AM Hello, starmyc! I add REDEN (https://github.com/RedenCore/Reden/blob/master/src/chainparams.cpp) But have error in cs.errors: ... terminate called after throwing an instance of 'std::out_of_range' what(): basic_string::substr: __pos (which is 1) > this->size() (which is 0) I'm sorry, but I'm too much busy to add all coins in the world, unfortunately :) I still have bugs I can't reproduce to fix for bitcoin core so... Title: Re: Get list of all addresses with a balance over x? Post by: champion357 on August 17, 2018, 09:58:36 AM how to do it?
Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on August 17, 2018, 09:59:09 AM can someone post a link to the new list? There isn't any. You could build it yourself though.There is: I compute a bunch of them everyday, and make them available on https://balances.syndevio.com/ Regards Title: Re: Get list of all addresses with a balance over x? Post by: TheArchaeologist on August 17, 2018, 10:44:47 AM how to do it? Maybe you shoud read the thread?Title: Re: Get list of all addresses with a balance over x? Post by: TheArchaeologist on August 17, 2018, 10:46:25 AM Quote There is: I compute a bunch of them everyday, and make them available on https://balances.syndevio.com/ You left out you are selling this info.Regards Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on August 17, 2018, 10:52:01 AM Quote There is: I compute a bunch of them everyday, and make them available on https://balances.syndevio.com/ You left out you are selling this info.Regards Source code I wrote for all this, with instruction to be able to reproduce, is opensource and links are on this page or within this thread. I'm not selling the information, I'm selling the hosting, the bandwidth & cpu processing. Regards. Title: Re: Get list of all addresses with a balance over x? Post by: TheArchaeologist on August 17, 2018, 10:55:44 AM Source code I wrote for all this, with instruction to be able to reproduce, is opensource and links are on this page or within this thread. I'm not selling the information, I'm selling the hosting, the bandwidth & cpu processing. Regards. Ok, you are free to do so. You just made it look like by providing that link it was available to download. But those in need can choose, do it themselves or have you do it for them. Title: Re: Get list of all addresses with a balance over x? Post by: champion357 on August 17, 2018, 04:34:19 PM Does someone have a current list? I will pay.
Title: Re: Get list of all addresses with a balance over x? Post by: btctousd81 on August 18, 2018, 12:23:38 PM Does someone have a current list? I will pay. how much , you are willing to pay ? i have latest list, updated 3 time per day. thanks Title: Re: Get list of all addresses with a balance over x? Post by: starmyc on August 18, 2018, 12:32:39 PM Does someone have a current list? I will pay. Someone generous enough made a donation on my service (may be you?). Thanks you, dear anonymous! Today's dump is right there: https://balances.syndevio.com/balances/balances-bitcoin-20180818-0000-X8o4l3K8.gz Have fun. Title: Re: Get list of all addresses with a balance over x? Post by: mazertwo on August 18, 2018, 05:54:08 PM Quote There is: I compute a bunch of them everyday, and make them available on https://balances.syndevio.com/ You left out you are selling this info.Regards Source code I wrote for all this, with instruction to be able to reproduce, is opensource and links are on this page or within this thread. I'm not selling the information, I'm selling the hosting, the bandwidth & cpu processing. Regards. Thank you, starmyc! You great man, and doing a great job! Title: Re: Get list of all addresses with a balance over x? Post by: aplistir on August 19, 2018, 02:47:12 PM Someone generous enough made a donation on my service (may be you?). Thanks you, dear anonymous! Today's dump is right there: https://balances.syndevio.com/balances/balances-bitcoin-20180818-0000-X8o4l3K8.gz I downloaded it yesterday. Thanks to you and whoever made the donation ;D Excellent work! PS. Pretty well compressed. How did you get 900Mb to shrink to 570Mb? Must be difficult, because the data is quite "random" Title: Re: Get list of all addresses with a balance over x? Post by: LoyceV on August 19, 2018, 07:43:47 PM PS. Pretty well compressed. How did you get 900Mb to shrink to 570Mb? It looks like standard gz-compression. It could probably have been smaller using bzip2, but that takes much longer to compress.Must be difficult, because the data is quite "random" Bitcoin addresses only use 56 different characters, and balances only 11. That leaves plenty of room for compression. |
