saberibm3
Newbie
Offline
Activity: 55
Merit: 0
|
|
April 14, 2018, 10:27:15 PM |
|
Blockparser is an excellent sorter but surely it needs greater RAM linux box
|
|
|
|
kajin
Newbie
Offline
Activity: 45
Merit: 0
|
|
April 15, 2018, 05:25:21 AM |
|
I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.
This is the closest thing I see already built but its for project's wallets.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 15, 2018, 03:13:49 PM |
|
Blockparser is an excellent sorter but surely it needs greater RAM linux box
What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk... Bottleneck is mostly CPU and I/O, not memory. I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.
This is the closest thing I see already built but its for project's wallets.
This is something that is really trivial to do (even for ERC20 tokens). Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 19, 2018, 08:38:01 PM |
|
For people interested, enjoy today's dump: http://bit.ly/2vqsDPX
|
|
|
|
guillzini
|
|
April 20, 2018, 08:12:02 AM |
|
Thank you for sharing once again! Much appreciated
|
|
|
|
btc-room101
|
|
April 20, 2018, 09:51:15 AM |
|
I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.
This is the closest thing I see already built but its for project's wallets.
I have all these addresses for ethereum and bitcoin, all sorted by files of 500k satoshi, 1m, and 10m, but these files are 10gb+ Same for ethereum files Somebody have an idea of how to upload this data for free? and keep up there for free? I wrote a new website that talks about these tools, getting the data is easy, sorting it, and running the processes every 10 minutes is the real work, not much use if the data 'old' in a few days inflection.top inflection@proton.com, give me some hints about how to get this data up, and if you want the ethereum first that's fine, I got the data, and don't use it much, mostly focus on the better stuff, and I don't consider ether that useful, I think after running 'brain-flayer' for months on eth I found TWO brain-wallets, compare that to btc, where there are +100k, but only 2k had value, and its long gone
|
|
|
|
btc-room101
|
|
April 20, 2018, 09:57:58 AM |
|
Blockparser is an excellent sorter but surely it needs greater RAM linux box
What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk... Bottleneck is mostly CPU and I/O, not memory. I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.
This is the closest thing I see already built but its for project's wallets.
This is something that is really trivial to do (even for ERC20 tokens). Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing. well you really don't use the 'data' per se, once you have the data you put it into bloom-filters (blf) files, but I use +16gb bloom's, not the 512mb stuff found on brain-flayer, then when you have super large lists like all the btc-addresses ever used, you need to use TRIES on these 32gb files, as searching in the unsorted/unprocessed file is impossible, which are binary sorted files, but super fast because they use binary search but again, the data is not much use, once you have it stored as bloom and trie for all the addresses, then there is no reason to ever work with the raw lists again the only case where I think its useful to keep 'lists' is for the public-key/private-key pairs, and their hash160 values, so that if you ever do find a HOT 'hash', you need to be able to map it back to that private-key you found ... Again you can't really work with these lists of addresses because its too slow to work on a 16gb file and use grep or sort to inquire
|
|
|
|
btc-room101
|
|
April 20, 2018, 10:08:20 AM |
|
Blockparser is an excellent sorter but surely it needs greater RAM linux box
It hasn't been maintained for 4+ years, It worked when the block chain was 10gb, and less than 100k blocks, but now at over 500k blocks it just breaks at around +400k no matter how much memory you have, besides its slow, it takes days just to get to 400k, then it dies, its not easy to maintain software There are dozens of these 'block-parsers' on GITHUB , but they have all been abandoned, even the few that 'work' don't really work, they usually break, because BTC keeps inventing new stuff on the block-chain, and the hex-decoders just abort when they see something they don't understand, I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or 10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff, Personally I think the pristine ( satoshi's coins ), and high-value public-key stuff is the real "GOLD" in this game. The average BTC used, is less than 0.05BTC of value, hardly worth the effort, even if its a random hit. inflection.com
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 20, 2018, 12:03:39 PM |
|
I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or 10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's
I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff,
What about sharing the code ? I would be more interested on code than on the result.
|
|
|
|
xraisers
Member
Offline
Activity: 266
Merit: 10
|
|
April 21, 2018, 07:04:51 PM |
|
I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 21, 2018, 07:24:25 PM |
|
I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.
Déja vu feeling.Strangely, I've already replied this sooner with week, before the original message got moderated. If your papier wallet received coins, the information is stored in the blockchain, and we know the address balance. If it doesn't, then we also know the balance, it is 0. In fact, we really don't care about the address type: paper wallet, hardware wallet, etc, an address is just an address, and they all work the same.
|
|
|
|
denish
Newbie
Offline
Activity: 172
Merit: 0
|
|
April 26, 2018, 04:23:21 PM |
|
Hello! The file is not available anymore Do you have another version? Thanks!
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 27, 2018, 11:26:04 AM Last edit: May 10, 2018, 03:41:16 PM by starmyc |
|
Hello! The file is not available anymore Do you have another version? Thanks! Yes, and this will be the last time I'll share it. Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it. The link is: http://bit.ly/BtcBalances20180427 Bonus points: - The LTC dump: http://bit.ly/LtcBalances20180427 - The Dash dump: http://bit.ly/DashBalances20180427Edit: Sorry, links are now down !Have a nice day!
|
|
|
|
denish
Newbie
Offline
Activity: 172
Merit: 0
|
|
April 27, 2018, 02:45:12 PM |
|
Thank you very much
|
|
|
|
denish
Newbie
Offline
Activity: 172
Merit: 0
|
|
April 27, 2018, 04:17:35 PM |
|
Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string". What is the "format" of these public keys in your file?
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
April 27, 2018, 07:06:17 PM |
|
Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string". What is the "format" of these public keys in your file? It works fine to me: >>> import base58 >>> base58.b58decode('LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg') b'0Zjvt\t\x16b=\xd8x\xd5\xdaW\n\xbd\xea|O\xaa\x0c\xfc\xa1\x95\xe7'
Or with bitcoin-tool: ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg --input-type address --input-format base58check --output-type all address.hex:305a6a76740916623dd878d5da570abdea7c4faa0c address.base58:3yTDzdkCyrchBhACqFECKwbqnKTKq address.base58check:LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg
bitcoin-tool does a checksum check. With an invalid address: $ ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmh --input-type address --input-format base58check --output-type all Failed to decode Base58Check input (checksum failure). You can use the --fix-base58check option to change the input string until the checksum is valid, but this may return a false positive match.
I do not know your library, but I would take a look at it first.
|
|
|
|
tmy
Newbie
Offline
Activity: 1
Merit: 0
|
|
May 12, 2018, 08:24:02 AM |
|
Can anyone share BTCbalance file as all links are dead?
Thanks
|
|
|
|
hatuey
Newbie
Offline
Activity: 54
Merit: 0
|
|
May 13, 2018, 03:41:03 AM |
|
All links are dead. could anyone share a copy or a recent dump?
|
|
|
|
starmyc
Full Member
Offline
Activity: 198
Merit: 130
Some random software engineer
|
|
May 13, 2018, 03:11:27 PM |
|
Can anyone share BTCbalance file as all links are dead?
Thanks
All links are dead. could anyone share a copy or a recent dump? Hi everyone, Since I've got multiple private messages for generating new dumps, I've decided to wrote a small web service to automatize the whole chain, and it is now available online, at this address: https://balances.syndevio.com/I came to that decision seeing that each dump I provided so far was downloaded more than an hundred times and well, bandwidth (and my time) is not free. For a few dust, the service makes links available to everyone for 3 days: You'll pay for my servers & the community. I also plan to add more coins in the future. I know my tools are compatible with dash, and I'm pretty sure all bitcoin/litecoin forks would work too. Just contact me if you want more information. And for people who doesn't want to pay (and I understand them), my tools - and alternatives - were already open-sourced (links are somewhere in this topic)! And for people I already made business with in the past, dumps are still free ! (I'll give you links on private request, as always).
|
|
|
|
AnnSerg77
Newbie
Offline
Activity: 140
Merit: 0
|
|
May 13, 2018, 07:59:03 PM |
|
I think... Wouldnt it be easiers if you pulled all discovered addresses from an existing db then query for there balances and filter out the ones?
|
|
|
|
|