Bitcoin Forum

Bitcoin => Development & Technical Discussion => Topic started by: jay2212 on September 15, 2019, 02:12:19 PM



Title: Generate All bitcoin addresses with balance
Post by: jay2212 on September 15, 2019, 02:12:19 PM
I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.


Title: Re: Generate All bitcoin addresses with balance
Post by: Rath_ on September 15, 2019, 02:49:20 PM
I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

You should be able to do it using this BlockParser (https://www.reddit.com/r/Bitcoin/comments/aab5uu/blockparser_a_way_to_get_the_balance_of_all/). Note that you will have to run a fully synchronised node with txindex set to 1.


Title: Re: Generate All bitcoin addresses with balance
Post by: crofrihosl on September 15, 2019, 11:09:37 PM
I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.


this website have all bitcoin addresses and sorted https://bitkeys.work/?page=0  8)

if someone have an idea to crawl and extract the list text file  ???


Title: Re: Generate All bitcoin addresses with balance
Post by: crofrihosl on September 17, 2019, 02:17:20 AM
You want to crawl 524620 pages? I'm afraid it's impossible if you're using customer desktop because :
1. Each page have size about 100KB (only HTML code tag, excluding all external files) or about 50GB in total
2. If they have protection against DDoS, bot or spammer, you'd be banned before you could crawl 500K pages

IMO contacting them to ask JSON/dumped SQL data is more realistic option.But it's one good website in this case.

it is possible  ;D
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop :'(


Title: Re: Generate All bitcoin addresses with balance
Post by: ABCbits on September 17, 2019, 05:35:56 PM
I was digging history of my spent merit and found https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

it is possible  ;D
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop :'(

Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?


Title: Re: Generate All bitcoin addresses with balance
Post by: starmyc on September 19, 2019, 05:18:25 AM
I was digging history of my spent merit and found https://github.com/mycroft/chainstate (https://github.com/mycroft/chainstate) which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

Thanks you quoting me!
The tool is still working great FYI, and https://balances.syndevio.com/ (https://balances.syndevio.com/) is still maintained with it too, for whoever might be insterested :-)


Title: Re: Generate All bitcoin addresses with balance
Post by: crofrihosl on September 19, 2019, 09:34:19 PM
Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?

write/edit some python or C++ scripts  ;D

1-concat all the 500k HTML pages into one file (or 50k pages each time)
2-use some condition delete/keep all lines with/contain
3-sort and done

i did try this  ;D



Title: Re: Generate All bitcoin addresses with balance
Post by: Paperweight on September 20, 2019, 04:43:02 AM
As an aside, the FAQ at https://bitkeys.work/faq.php (https://bitkeys.work/faq.php) seems a bit...wrong and alarmist?

He's implying that you need 2^80 (~1e24) tries to get a 50% chance of "colliding with one of those keys" (using the birthday paradox). Which seems pretty bad given the current network hashrate of ~1e20 H/s.

But... I think you'd only be colliding with one of your other zillion collision attempts, not one of the relatively miniscule ~1e8 addresses actually used. Unless my math is wrong. *shrug*

(1eX = 1*10^X)

More info: https://download.wpsoftware.net/bitcoin-birthday.pdf (https://download.wpsoftware.net/bitcoin-birthday.pdf)


Title: Re: Generate All bitcoin addresses with balance
Post by: lightningmelo on September 20, 2019, 06:52:29 PM
What you are looking for is the current UTXO set.

UTXO stands for Unspent Transaction Output.

This is the set of all the transaction outputs that can be spent.


Title: Re: Generate All bitcoin addresses with balance
Post by: databoi on June 02, 2022, 01:34:30 PM
I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin (https://www.dolthub.com/repositories/web3/bitcoin). It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ (https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/) for some ideas.


Title: Re: Generate All bitcoin addresses with balance
Post by: NotATether on June 03, 2022, 03:25:31 AM
All this parsing is in fact unnecessary because @LoyceV has a project called List of all Bitcoin addresses with a balance (https://bitcointalk.org/index.php?topic=5254914.0) that is updated daily with address dumps from Blockchair.

It is merely a text file of addresses with balances next to them.


Title: Re: Generate All bitcoin addresses with balance
Post by: PawGo on June 03, 2022, 07:38:48 AM
I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin (https://www.dolthub.com/repositories/web3/bitcoin). It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ (https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/) for some ideas.

Very interesting, I was not aware of that. Usually what I do for my needs (if I need to check many addresses from program), is just to download snapshot with addresses/balances etc and load into postgresql database.
I will take a look at that project, if it save me some time, I would probably start using it.