Bitcoin Forum
November 21, 2018, 09:35:35 PM *
News: Latest Bitcoin Core release: 0.17.0 [Torrent].
 
   Home   Help Search Login Register More  
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 [13] 14 15 16 17 »  All
  Print  
Author Topic: Get list of all addresses with a balance over x?  (Read 41409 times)
LoyceV
Legendary
*
Online Online

Activity: 1316
Merit: 2279


Self-made Legendary!


View Profile WWW
April 11, 2018, 09:01:43 PM
 #241

The truth is it doesn't take me a lot of time to generate it. The time is spent uploading to my server. And the main problem is that quality bandwidth costs money, and well, some people helped me but still!
I'm still looking for a solution to automatize all this and that satisfies me.
I'm quite satisfied with 000webhostapp.com, although the free hosting can fit your file only once. I can use CLI to upload/FTP files from within a script.

I haven't tried it, but 🚀 BitcoinTalk's FREE Web Host 🚀 [🔥 EXCLUSIVE 🔥] (Scalable) 2GB Disk could be an option for you too.

1542836135
Hero Member
*
Offline Offline

Posts: 1542836135

View Profile Personal Message (Offline)

Ignore
1542836135
Reply with quote  #2

1542836135
Report to moderator
1542836135
Hero Member
*
Offline Offline

Posts: 1542836135

View Profile Personal Message (Offline)

Ignore
1542836135
Reply with quote  #2

1542836135
Report to moderator
1542836135
Hero Member
*
Offline Offline

Posts: 1542836135

View Profile Personal Message (Offline)

Ignore
1542836135
Reply with quote  #2

1542836135
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1542836135
Hero Member
*
Offline Offline

Posts: 1542836135

View Profile Personal Message (Offline)

Ignore
1542836135
Reply with quote  #2

1542836135
Report to moderator
1542836135
Hero Member
*
Offline Offline

Posts: 1542836135

View Profile Personal Message (Offline)

Ignore
1542836135
Reply with quote  #2

1542836135
Report to moderator
saberibm3
Newbie
*
Offline Offline

Activity: 55
Merit: 0


View Profile
April 14, 2018, 10:27:15 PM
 #242

Blockparser is an excellent sorter but surely it needs  greater RAM linux box
kajin
Newbie
*
Offline Offline

Activity: 47
Merit: 0


View Profile
April 15, 2018, 05:25:21 AM
 #243

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 15, 2018, 03:13:49 PM
 #244

Blockparser is an excellent sorter but surely it needs greater RAM linux box

What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk...
Bottleneck is mostly CPU and I/O, not memory.

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

This is something that is really trivial to do (even for ERC20 tokens).
Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing.

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 19, 2018, 08:38:01 PM
 #245

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
guillzini
Full Member
***
Offline Offline

Activity: 476
Merit: 100



View Profile
April 20, 2018, 08:12:02 AM
 #246

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Thank you for sharing once again! Much appreciated Smiley

▼ DarkPayCoin - [100% community governed and built]
[-] Website  [-] ANN Thread  [-] Discord  [-] Twitter  [-] Telegram
\ HIGH ROI, Low supply / - \ A privacy focused MN/PoS coin /
btc-room101
Newbie
*
Offline Offline

Activity: 14
Merit: 0


View Profile
April 20, 2018, 09:51:15 AM
 #247

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

I have all these addresses for ethereum and bitcoin, all sorted by files of 500k satoshi, 1m, and 10m, but these files are 10gb+
Same for ethereum files

Somebody have an idea of how to upload this data for free? and keep up there for free?

I wrote a new website that talks about these tools, getting the data is easy, sorting it, and running the processes every 10 minutes is the real work, not much use if the data 'old' in a few days

inflection.top

inflection@proton.com, give me some hints about how to get this data up, and if you want the ethereum first that's fine, I got the data, and don't use it much, mostly focus on the better stuff, and I don't consider ether that useful, I think after running 'brain-flayer' for months on eth I found TWO brain-wallets, compare that to btc, where there are +100k, but only 2k had value, and its long gone
btc-room101
Newbie
*
Offline Offline

Activity: 14
Merit: 0


View Profile
April 20, 2018, 09:57:58 AM
 #248

Blockparser is an excellent sorter but surely it needs greater RAM linux box

What do you want to store in memory? There is nearly nothing to store in memory. Once parsed, your block datas will most likely be stored on hard disk...
Bottleneck is mostly CPU and I/O, not memory.

I would like to see this but for ethereum addresses. It'd be interesting to see what whales are holding.

This is the closest thing I see already built but its for project's wallets.

This is something that is really trivial to do (even for ERC20 tokens).
Ethereum provides ready to use apis in multiple languages (js, golang) in addition of the json rpc api. You can grab blocks, transactions, etc in just a few lines of code, and you'll just need some time to process the whole thing.


well you really don't use the 'data' per se, once you have the data you put it into bloom-filters (blf) files, but I use +16gb bloom's, not the 512mb stuff found on brain-flayer, then when you have super large lists like all the btc-addresses ever used, you need to use TRIES on these 32gb files, as searching in the unsorted/unprocessed file is impossible, which are binary sorted files, but super fast because they use binary search

but again, the data is not much use, once you have it stored as bloom and trie for all the addresses, then there is no reason to ever work with the raw lists again

the only case where I think its useful to keep 'lists' is for the public-key/private-key pairs, and their hash160 values, so that if you ever do find a HOT 'hash', you need to be able to map it back to that private-key you found

...

Again you can't really work with these lists of addresses because its too slow to work on a 16gb file and use grep or sort to inquire
btc-room101
Newbie
*
Offline Offline

Activity: 14
Merit: 0


View Profile
April 20, 2018, 10:08:20 AM
 #249

Blockparser is an excellent sorter but surely it needs  greater RAM linux box

It hasn't been maintained for 4+ years,

It worked when the block chain was 10gb, and less than 100k blocks,  but now at over 500k blocks it just breaks at around +400k no matter how much memory you have, besides its slow, it takes days just to get to 400k, then it dies, its not easy to maintain software

There are dozens of these 'block-parsers' on GITHUB , but they have all been abandoned, even the few that 'work' don't really work, they usually break, because BTC keeps inventing new stuff on the block-chain, and the hex-decoders just abort when they see something they don't understand,

I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or  10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's

I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff,

Personally I think the pristine ( satoshi's coins ), and high-value public-key stuff is the real "GOLD" in this game.

The average BTC used, is less than 0.05BTC of value, hardly worth the effort, even if its a random hit.

inflection.com
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 20, 2018, 12:03:39 PM
 #250

I have never found anything on GITHUB that works, the best you can do is 'roll-your-own' in python, and process the raw-blockchain, don't use RPC it will take weeks, it takes me 3 days to do an entire blockchain, and I always to run's like over 1M satoshi, or 10M, or 1BTC or  10BTC, and then have files for each collection, the files for 1M satoshi are huge ( 10's of gigabytes ) to dump all hash160's

I see the transfer.sh that people mention here, perhaps the btc has already been uploaded, so if anybody wants I could upload the ethereum stuff,

What about sharing the code ? I would be more interested on code than on the result.

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
xraisers
Member
**
Offline Offline

Activity: 266
Merit: 10


View Profile
April 21, 2018, 07:04:51 PM
 #251

I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 21, 2018, 07:24:25 PM
 #252

I don't think it is possible to get all the addresses given that many addresses are not known on the network (think paper wallets). Until an address has done a transaction on the network or a key is published online it is not possible to know the balance of that address.

Déja vu feeling.Strangely, I've already replied this sooner with week, before the original message got moderated.

If your papier wallet received coins, the information is stored in the blockchain, and we know the address balance. If it doesn't, then we also know the balance, it is 0.
In fact, we really don't care about the address type: paper wallet, hardware wallet, etc, an address is just an address, and they all work the same.

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
denish
Newbie
*
Offline Offline

Activity: 143
Merit: 0


View Profile
April 26, 2018, 04:23:21 PM
 #253

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Sad Do you have another version? Smiley

Thanks!
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 27, 2018, 11:26:04 AM
Merited by suchmoon (1)
 #254

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Sad Do you have another version? Smiley

Thanks!

Yes, and this will be the last time I'll share it.

Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it.

The link is: http://bit.ly/BtcBalances20180427
Bonus points:
- The LTC dump: http://bit.ly/LtcBalances20180427
- The Dash dump: http://bit.ly/DashBalances20180427


Edit: Sorry, links are now down !

Have a nice day!

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
denish
Newbie
*
Offline Offline

Activity: 143
Merit: 0


View Profile
April 27, 2018, 02:45:12 PM
 #255

For people interested, enjoy today's dump: http://bit.ly/2vqsDPX

Hello!

The file is not available anymore Sad Do you have another version? Smiley

Thanks!

Yes, and this will be the last time I'll share it.

Next dump will be available to people that thanks my work by tipping me, on request! For others, I've already release the source code that generates it.

The link is: http://bit.ly/BtcBalances20180427
Bonus points:
- The LTC dump: http://bit.ly/LtcBalances20180427
- The Dash dump: http://bit.ly/DashBalances20180427

Have a nice day!

Thank you very much Smiley
denish
Newbie
*
Offline Offline

Activity: 143
Merit: 0


View Profile
April 27, 2018, 04:17:35 PM
 #256

Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string".

What is the "format" of these public keys in your file? Smiley
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
April 27, 2018, 07:06:17 PM
 #257

Little question... I am trying to parse one of these keys in C# with "NBitCoin" library: "LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg" but I have an error -> "Invalid base58 string".

What is the "format" of these public keys in your file? Smiley

It works fine to me:

Code:
>>> import base58
>>> base58.b58decode('LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg')
b'0Zjvt\t\x16b=\xd8x\xd5\xdaW\n\xbd\xea|O\xaa\x0c\xfc\xa1\x95\xe7'

Or with bitcoin-tool:

Code:
./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg --input-type address --input-format base58check --output-type all
address.hex:305a6a76740916623dd878d5da570abdea7c4faa0c
address.base58:3yTDzdkCyrchBhACqFECKwbqnKTKq
address.base58check:LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmg

bitcoin-tool does a checksum check. With an invalid address:

Code:
$ ./bitcoin-tool --network litecoin --input LTU2cds4aSdXFip9sV4gXphnhxGQjgfjmh --input-type address --input-format base58check --output-type all
Failed to decode Base58Check input (checksum failure).
You can use the --fix-base58check option to change the input string until the checksum is valid, but this may return a false positive match.

I do not know your library, but I would take a look at it first.


Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
tmy
Newbie
*
Offline Offline

Activity: 1
Merit: 0


View Profile
May 12, 2018, 08:24:02 AM
 #258

Can anyone share BTCbalance file as all links are dead?

Thanks
hatuey
Newbie
*
Offline Offline

Activity: 54
Merit: 0


View Profile
May 13, 2018, 03:41:03 AM
 #259

All links are dead. could anyone share a copy or a recent dump?  Sad
starmyc
Member
**
Offline Offline

Activity: 194
Merit: 86

Software engineer


View Profile WWW
May 13, 2018, 03:11:27 PM
 #260

Can anyone share BTCbalance file as all links are dead?

Thanks

All links are dead. could anyone share a copy or a recent dump?  Sad

Hi everyone,

Since I've got multiple private messages for generating new dumps, I've decided to wrote a small web service to automatize the whole chain, and it is now available online, at this address: https://balances.syndevio.com/

I came to that decision seeing that each dump I provided so far was downloaded more than an hundred times and well, bandwidth (and my time) is not free.

For a few dust, the service makes links available to everyone for 3 days: You'll pay for my servers & the community.

I also plan to add more coins in the future. I know my tools are compatible with dash, and I'm pretty sure all bitcoin/litecoin forks would work too. Just contact me if you want more information. Smiley

And for people who doesn't want to pay (and I understand them), my tools - and alternatives - were already open-sourced (links are somewhere in this topic)! And for people I already made business with in the past, dumps are still free ! (I'll give you links on private request, as always).

Software engineer.
Tip me if you find my help useful: 3QBRMM2CLUTd7hqL4T9Ja2wy6B1VkbXyZ3
Pages: « 1 2 3 4 5 6 7 8 9 10 11 12 [13] 14 15 16 17 »  All
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!