Bitcoin Forum
October 22, 2019, 10:28:23 AM *
News: 10th anniversary art contest
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Generate All bitcoin addresses with balance  (Read 232 times)
jay2212
Newbie
*
Offline Offline

Activity: 1
Merit: 0


View Profile
September 15, 2019, 02:12:19 PM
 #1

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.
1571740103
Hero Member
*
Offline Offline

Posts: 1571740103

View Profile Personal Message (Offline)

Ignore
1571740103
Reply with quote  #2

1571740103
Report to moderator
1571740103
Hero Member
*
Offline Offline

Posts: 1571740103

View Profile Personal Message (Offline)

Ignore
1571740103
Reply with quote  #2

1571740103
Report to moderator
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
BitCryptex
Hero Member
*****
Offline Offline

Activity: 728
Merit: 1051


Write @BitCryptex or quote my post to notify me


View Profile WWW
September 15, 2019, 02:49:20 PM
 #2

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

You should be able to do it using this BlockParser. Note that you will have to run a fully synchronised node with txindex set to 1.

ETFbitcoin
Legendary
*
Offline Offline

Activity: 1792
Merit: 2055

Use SegWit and enjoy lower fees.


View Profile WWW
September 15, 2019, 06:10:14 PM
 #3

If you don't want or can't run full nodes, you also can check https://blockchair.com which have API and SQL features.

Check https://github.com/Blockchair/Blockchair.Support/blob/master/API_DOCUMENTATION_EN.md#link_bitcoinaddresses for starter.
Don't forget you need to register for API key first.

crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 15, 2019, 11:09:37 PM
Merited by ETFbitcoin (1), hugeblack (1)
 #4

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.


this website have all bitcoin addresses and sorted https://bitkeys.work/?page=0  Cool

if someone have an idea to crawl and extract the list text file  Huh
ETFbitcoin
Legendary
*
Offline Offline

Activity: 1792
Merit: 2055

Use SegWit and enjoy lower fees.


View Profile WWW
September 16, 2019, 05:21:15 PM
 #5

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.


this website have all bitcoin addresses and sorted https://bitkeys.work/?page=0  Cool

if someone have an idea to crawl and extract the list text file  Huh

You want to crawl 524620 pages? I'm afraid it's impossible if you're using customer desktop because :
1. Each page have size about 100KB (only HTML code tag, excluding all external files) or about 50GB in total
2. If they have protection against DDoS, bot or spammer, you'd be banned before you could crawl 500K pages

IMO contacting them to ask JSON/dumped SQL data is more realistic option. But it's one good website in this case.

crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 17, 2019, 02:17:20 AM
 #6

You want to crawl 524620 pages? I'm afraid it's impossible if you're using customer desktop because :
1. Each page have size about 100KB (only HTML code tag, excluding all external files) or about 50GB in total
2. If they have protection against DDoS, bot or spammer, you'd be banned before you could crawl 500K pages

IMO contacting them to ask JSON/dumped SQL data is more realistic option.But it's one good website in this case.

it is possible  Grin
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop Cry
ETFbitcoin
Legendary
*
Offline Offline

Activity: 1792
Merit: 2055

Use SegWit and enjoy lower fees.


View Profile WWW
September 17, 2019, 05:35:56 PM
Merited by starmyc (1)
 #7

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

it is possible  Grin
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop Cry

Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?

starmyc
Member
**
Offline Offline

Activity: 196
Merit: 88

Some random software engineer


View Profile
September 19, 2019, 05:18:25 AM
 #8

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

Thanks you quoting me!
The tool is still working great FYI, and https://balances.syndevio.com/ is still maintained with it too, for whoever might be insterested :-)

Hi, I'm just some random software engineer.
You can check my projects: Bitcoin & altcoin balances dumps: https://balances.syndevio.com/
crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 19, 2019, 09:34:19 PM
 #9

Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?

write/edit some python or C++ scripts  Grin

1-concat all the 500k HTML pages into one file (or 50k pages each time)
2-use some condition delete/keep all lines with/contain
3-sort and done

i did try this  Grin

Paperweight
Newbie
*
Offline Offline

Activity: 27
Merit: 0



View Profile
September 20, 2019, 04:43:02 AM
 #10

As an aside, the FAQ at https://bitkeys.work/faq.php seems a bit...wrong and alarmist?

He's implying that you need 2^80 (~1e24) tries to get a 50% chance of "colliding with one of those keys" (using the birthday paradox). Which seems pretty bad given the current network hashrate of ~1e20 H/s.

But... I think you'd only be colliding with one of your other zillion collision attempts, not one of the relatively miniscule ~1e8 addresses actually used. Unless my math is wrong. *shrug*

(1eX = 1*10^X)

More info: https://download.wpsoftware.net/bitcoin-birthday.pdf
lightningmelo
Copper Member
Member
**
Offline Offline

Activity: 70
Merit: 20


View Profile WWW
September 20, 2019, 06:52:29 PM
 #11

What you are looking for is the current UTXO set.

UTXO stands for Unspent Transaction Output.

This is the set of all the transaction outputs that can be spent.

Pages: [1]
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!