Get list of all addresses with a balance over x?

[saberibm3]

Blockparser is an excellent sorter but surely it needs  greater RAM linux box

[1713422756]

1713422756

[1713422756]

1713422756

[1713422756]

1713422756

[kajin]

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

[starmyc]

Blockparser is an excellent sorter but surely it needs greater RAM linux box

What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk...
Bottleneck is mostly CPU and I/O, not memory.

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

This is something that is really trivial to do (even for ERC20 tokens).
Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing.

[starmyc]

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

[guillzini]

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Thank you for sharing once again! Much appreciated

[btc-room101]

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

I have all these addresses for ethereum and bitcoin, all sorted by files of 500k satoshi, 1m, and 10m, but these files are 10gb+
Same for ethereum files

Somebody have an idea of how to upload this data for free? and keep up there for free?

I wrote a new website that talks about these tools, getting the data is easy, sorting it, and running the processes every 10 minutes is the real work, not much use if the data 'old' in a few days

inflection.top

inflection@proton.com, give me some hints about how to get this data up, and if you want the ethereum first that's fine, I got the data, and don't use it much, mostly focus on the better stuff, and I don't consider ether that useful, I think after running 'brain-flayer' for months on eth I found TWO brain-wallets, compare that to btc, where there are +100k, but only 2k had value, and its long gone

[btc-room101]

Blockparser is an excellent sorter but surely it needs greater RAM linux box

What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk...
Bottleneck is mostly CPU and I/O, not memory.

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

This is something that is really trivial to do (even for ERC20 tokens).
Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing.

well you really don't use the 'data' per se, once you have the data you put it into bloom-filters (blf) files, but I use +16gb bloom's, not the 512mb stuff found on brain-flayer, then when you have super large lists like all the btc-addresses ever used, you need to use TRIES on these 32gb files, as searching in the unsorted/unprocessed file is impossible, which are binary sorted files, but super fast because they use binary search

but again, the data is not much use, once you have it stored as bloom and trie for all the addresses, then there is no reason to ever work with the raw lists again

the only case where I think its useful to keep 'lists' is for the public-key/private-key pairs, and their hash160 values, so that if you ever do find a HOT 'hash', you need to be able to map it back to that private-key you found

...

Again you can't really work with these lists of addresses because its too slow to work on a 16gb file and use grep or sort to inquire

[btc-room101]

Blockparser is an excellent sorter but surely it needs  greater RAM linux box

It hasn't been maintained for 4+ years,

It worked when the block chain was 10gb, and less than 100k blocks,  but now at over 500k blocks it just breaks at around +400k no matter how much memory you have, besides its slow, it takes days just to get to 400k, then it dies, its not easy to maintain software

There are dozens of these 'block-parsers' on GITHUB , but they have all been abandoned, even the few that 'work' don't really work, they usually break, because BTC keeps inventing new stuff on the block-chain, and the hex-decoders just abort when they see something they don't understand,

I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or  10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's

I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff,

Personally I think the pristine ( satoshi's coins ), and high-value public-key stuff is the real "GOLD" in this game.

The average BTC used, is less than 0.05BTC of value, hardly worth the effort, even if its a random hit.

inflection.com

[starmyc]

I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or  10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's

I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff,

What about sharing the code ? I would be more interested on code than on the result.

[xraisers]

I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.

[starmyc]

I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.

Déja vu feeling.Strangely, I've already replied this sooner with week, before the original message got moderated.

If your papier wallet received coins, the information is stored in the blockchain, and we know the address balance. If it doesn't, then we also know the balance, it is 0.
In fact, we really don't care about the address type: paper wallet, hardware wallet, etc, an address is just an address, and they all work the same.

[denish]

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Do you have another version?

Thanks!

[starmyc]

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Do you have another version?

Thanks!

Yes, and this will be the last time I'll share it.

Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it.

The link is: http://bit.ly/BtcBalances20180427
Bonus points:
- The LTC dump: http://bit.ly/LtcBalances20180427
- The Dash dump: http://bit.ly/DashBalances20180427

Edit: Sorry, links are now down !

Have a nice day!

[denish]

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Do you have another version?

Thanks!

Yes, and this will be the last time I'll share it.

Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it.

The link is: http://bit.ly/BtcBalances20180427
Bonus points:
- The LTC dump: http://bit.ly/LtcBalances20180427
- The Dash dump: http://bit.ly/DashBalances20180427

Have a nice day!

Thank you very much

[denish]

Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string".

What is the "format" of these public keys in your file?

[starmyc]

Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string".

What is the "format" of these public keys in your file?

It works fine to me:

Code:

>>> import base58
>>> base58.b58decode('LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg')
b'0Zjvt\t\x16b=\xd8x\xd5\xdaW\n\xbd\xea|O\xaa\x0c\xfc\xa1\x95\xe7'

Or with bitcoin-tool:

Code:

./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg --input-type address --input-format base58check --output-type all
address.hex:305a6a76740916623dd878d5da570abdea7c4faa0c
address.base58:3yTDzdkCyrchBhACqFECKwbqnKTKq
address.base58check:LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg

bitcoin-tool does a checksum check. With an invalid address:

Code:

$ ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmh --input-type address --input-format base58check --output-type all
Failed to decode Base58Check input (checksum failure).
You can use the --fix-base58check option to change the input string until the checksum is valid, but this may return a false positive match.

I do not know your library, but I would take a look at it first.

[tmy]

Can anyone share BTCbalance file as all links are dead?

Thanks

[hatuey]

All links are dead. could anyone share a copy or a recent dump? 

[starmyc]

Can anyone share BTCbalance file as all links are dead?

Thanks

All links are dead. could anyone share a copy or a recent dump? 

Hi everyone,

Since I've got multiple private messages for generating new dumps, I've decided to wrote a small web service to automatize the whole chain, and it is now available online, at this address: https://balances.syndevio.com/

I came to that decision seeing that each dump I provided so far was downloaded more than an hundred times and well, bandwidth (and my time) is not free.

For a few dust, the service makes links available to everyone for 3 days: You'll pay for my servers & the community.

I also plan to add more coins in the future. I know my tools are compatible with dash, and I'm pretty sure all bitcoin/litecoin forks would work too. Just contact me if you want more information.

And for people who doesn't want to pay (and I understand them), my tools - and alternatives - were already open-sourced (links are somewhere in this topic)! And for people I already made business with in the past, dumps are still free ! (I'll give you links on private request, as always).

[AnnSerg77]

I think... Wouldnt it be easiers if you pulled all discovered addresses from an existing db
then query for there balances
and filter out the ones?