Bitcoin Forum
April 19, 2024, 03:51:01 PM *
News: Latest Bitcoin Core release: 26.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Generate All bitcoin addresses with balance  (Read 472 times)
jay2212 (OP)
Newbie
*
Offline Offline

Activity: 1
Merit: 0


View Profile
September 15, 2019, 02:12:19 PM
 #1

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.
1713541861
Hero Member
*
Offline Offline

Posts: 1713541861

View Profile Personal Message (Offline)

Ignore
1713541861
Reply with quote  #2

1713541861
Report to moderator
1713541861
Hero Member
*
Offline Offline

Posts: 1713541861

View Profile Personal Message (Offline)

Ignore
1713541861
Reply with quote  #2

1713541861
Report to moderator
1713541861
Hero Member
*
Offline Offline

Posts: 1713541861

View Profile Personal Message (Offline)

Ignore
1713541861
Reply with quote  #2

1713541861
Report to moderator
"With e-currency based on cryptographic proof, without the need to trust a third party middleman, money can be secure and transactions effortless." -- Satoshi
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
Rath_
aka BitCryptex
Legendary
*
Offline Offline

Activity: 1876
Merit: 3131



View Profile
September 15, 2019, 02:49:20 PM
 #2

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.

You should be able to do it using this BlockParser. Note that you will have to run a fully synchronised node with txindex set to 1.
crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 15, 2019, 11:09:37 PM
Merited by ABCbits (1), hugeblack (1)
 #3

I was wondering if there was a way to retrieve all bitcoin public addresses with a non-zero balance.


this website have all bitcoin addresses and sorted https://bitkeys.work/?page=0  Cool

if someone have an idea to crawl and extract the list text file  Huh
crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 17, 2019, 02:17:20 AM
 #4

You want to crawl 524620 pages? I'm afraid it's impossible if you're using customer desktop because :
1. Each page have size about 100KB (only HTML code tag, excluding all external files) or about 50GB in total
2. If they have protection against DDoS, bot or spammer, you'd be banned before you could crawl 500K pages

IMO contacting them to ask JSON/dumped SQL data is more realistic option.But it's one good website in this case.

it is possible  Grin
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop Cry
ABCbits
Legendary
*
Offline Offline

Activity: 2856
Merit: 7385


Crypto Swap Exchange


View Profile
September 17, 2019, 05:35:56 PM
Merited by pooya87 (2), starmyc (1)
 #5

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

it is possible  Grin
1- with idm go to tasks > add batch download>from 0 to 1000> ok (about 110MB) (50*1000=50k top bitcoin addresses)
concatenating all the htmls files in one html edit with notepad++ the final file and make sure to only keep the addresses in first column 

(you need to repeat this many times)

i did try this ... bored and stop Cry

Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?

█▀▀▀











█▄▄▄
▀▀▀▀▀▀▀▀▀▀▀
e
▄▄▄▄▄▄▄▄▄▄▄
█████████████
████████████▄███
██▐███████▄█████▀
█████████▄████▀
███▐████▄███▀
████▐██████▀
█████▀█████
███████████▄
████████████▄
██▄█████▀█████▄
▄█████████▀█████▀
███████████▀██▀
████▀█████████
▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀
c.h.
▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄
▀▀▀█











▄▄▄█
▄██████▄▄▄
█████████████▄▄
███████████████
███████████████
███████████████
███████████████
███░░█████████
███▌▐█████████
█████████████
███████████▀
██████████▀
████████▀
▀██▀▀
starmyc
Full Member
***
Offline Offline

Activity: 198
Merit: 130

Some random software engineer


View Profile
September 19, 2019, 05:18:25 AM
 #6

I was digging history of my spent merit and found https://github.com/mycroft/chainstate which parse UTXO from Bitcoin Core chainstate.
I think this is what you're looking for.

Thanks you quoting me!
The tool is still working great FYI, and https://balances.syndevio.com/ is still maintained with it too, for whoever might be insterested :-)

Hi, I'm just some random software engineer.
You can check my projects: Bitcoin & altcoin balances/addresses listing dumps: https://balances.crypto-nerdz.org/
crofrihosl
Jr. Member
*
Offline Offline

Activity: 56
Merit: 3


View Profile
September 19, 2019, 09:34:19 PM
 #7

Possible if you have unlimited tons of time to be wasted, would you want to edit 500K HTML pages manually?

write/edit some python or C++ scripts  Grin

1-concat all the 500k HTML pages into one file (or 50k pages each time)
2-use some condition delete/keep all lines with/contain
3-sort and done

i did try this  Grin

Paperweight
Jr. Member
*
Offline Offline

Activity: 41
Merit: 41



View Profile
September 20, 2019, 04:43:02 AM
 #8

As an aside, the FAQ at https://bitkeys.work/faq.php seems a bit...wrong and alarmist?

He's implying that you need 2^80 (~1e24) tries to get a 50% chance of "colliding with one of those keys" (using the birthday paradox). Which seems pretty bad given the current network hashrate of ~1e20 H/s.

But... I think you'd only be colliding with one of your other zillion collision attempts, not one of the relatively miniscule ~1e8 addresses actually used. Unless my math is wrong. *shrug*

(1eX = 1*10^X)

More info: https://download.wpsoftware.net/bitcoin-birthday.pdf
lightningmelo
Copper Member
Member
**
Offline Offline

Activity: 70
Merit: 22


View Profile WWW
September 20, 2019, 06:52:29 PM
 #9

What you are looking for is the current UTXO set.

UTXO stands for Unspent Transaction Output.

This is the set of all the transaction outputs that can be spent.

databoi
Newbie
*
Offline Offline

Activity: 5
Merit: 83


View Profile
June 02, 2022, 01:34:30 PM
Merited by Welsh (2)
 #10

I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin. It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ for some ideas.
NotATether
Legendary
*
Offline Offline

Activity: 1582
Merit: 6670


bitcoincleanup.com / bitmixlist.org


View Profile WWW
June 03, 2022, 03:25:31 AM
 #11

All this parsing is in fact unnecessary because @LoyceV has a project called List of all Bitcoin addresses with a balance that is updated daily with address dumps from Blockchair.

It is merely a text file of addresses with balances next to them.

.
.BLACKJACK ♠ FUN.
█████████
██████████████
████████████
█████████████████
████████████████▄▄
░█████████████▀░▀▀
██████████████████
░██████████████
████████████████
░██████████████
████████████
███████████████░██
██████████
CRYPTO CASINO &
SPORTS BETTING
▄▄███████▄▄
▄███████████████▄
███████████████████
█████████████████████
███████████████████████
█████████████████████████
█████████████████████████
█████████████████████████
███████████████████████
█████████████████████
███████████████████
▀███████████████▀
█████████
.
PawGo
Legendary
*
Offline Offline

Activity: 952
Merit: 1367


View Profile
June 03, 2022, 07:38:48 AM
 #12

I open-sourced the Bitcoin blockchain https://www.dolthub.com/repositories/web3/bitcoin. It's a little behind (will catch up soon to the head block) but you can easily query all wallets in SQL with it. CC this blog https://www.dolthub.com/blog/2022-06-01-free-the-sql-data/ for some ideas.

Very interesting, I was not aware of that. Usually what I do for my needs (if I need to check many addresses from program), is just to download snapshot with addresses/balances etc and load into postgresql database.
I will take a look at that project, if it save me some time, I would probably start using it.
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!