List of all Bitcoin addresses with a balance

[Mek]

The list is currently a few days behind again

[LoyceV]

The list is currently a few days behind again

If blockchair's data source is outdated, my data is outdated too. Unfortunately I don't have the disk space anymore to scrape my own blockchain.

[LoyceV]

The list is currently a few days behind again

It works again, since a week now. See addresses.loyce.club.

[id104335409]

Hey guys,
can we have a list of only addresses with more than 1 BTC - the so called Rich List.
I need one because the full list is more than 2GB now and that tends to slow some programs down. A lightweight version would be really nice, but I can't find any.
Much appreciated.

[LoyceV]

can we have a list of only addresses with more than 1 BTC - the so called Rich List.
I need one because the full list is more than 2GB now and that tends to slow some programs down.

So you want to steal millions by brute-forcing Bitcoin addresses, but you can't figure out how to download blockchair_bitcoin_addresses_and_balance_LATEST.tsv.gz (which is sorted by highest balance first) and use only the top of this file?

[bitmover]

Hey guys,
can we have a list of only addresses with more than 1 BTC - the so called Rich List.
I need one because the full list is more than 2GB now and that tends to slow some programs down. A lightweight version would be really nice, but I can't find any.
Much appreciated.

You can use python and the pandas library. It will open files of any size and sort and slice them data easily.
Ask chatpgpt for help , it is east. But you won't make any money brute forcing them.

[AGG2017]

It should be something like this (not tested):

awk -F'\t' 'NR>1 && $2>=100000000{print $1}' blockchair_bitcoin_addresses_and_balance_LATEST.tsv > blockchair_bitcoin_addresses_selected.txt

The probability to match by brute force so small number of addresses from the entire set is so small that you should be extremely lucky if you can find even an address with 1 satoshi in it. Asking for reduced number of addresses is telling me you have a weak hardware. This is not what you need for this task. You may need the entire calculating power available on Earth for many years.

[LoyceV]

It should be something like this (not tested):

I would wget the .gz file, pipe it through gunzip, and go from there. That way you only need to download a fraction of the file if you kill it once you reach amounts lower than the desired minimum.

[albert0bsd]

Bump

Hahaha, is this post something that really needs a BTCump?

Always that a user ask me for a list of addresses with balance I always suggest them to search on google for "LoyceV  addresses with balance" and it always works



After that users always ask about how to process/edit or manage those big files... most of them don't know any Linux environment or command   

Anyway thanks for your contributions to this community.

[LoyceV]

Hahaha, is this post something that really needs a BTCump?

I noticed my bandwidth consumption dropped from 20 to 14 TB/month But now that I think about it, my memory may be incorrect. I think it used to be 10 TB/month, which means it increased. I'm not so sure anymore, I don't really keep track.

After that users always ask about how to process/edit or manage those big files... most of them don't know any Linux environment or command  

If you know an equivalent that works in Windows, please post it.

Anyway thanks for your contributions to this community.

No problem

[Mek]

I noticed my bandwidth consumption dropped from 20 to 14 TB/month But now that I think about it, my memory may be incorrect. I think it used to be 10 TB/month, which means it increased. I'm not so sure anymore, I don't really keep track.

Possibly because there were many days without update. No need to redownload old files.

[LoyceV]

It looks like my server is gone I'm waiting for a response from my sponsor.

[Vod]

It looks like my server is gone I'm waiting for a response from my sponsor.

Still working for me.  https://loyce.club/

[LoyceV]

Still working for me.  https://loyce.club/

That's on AWS, still going strong. "This topic" is on my dedicated Xeon server:

The data
See addresses.loyce.club. I keep 18 snapshots of Blockchair's daily data.

[LoyceV]

Update:
I have a new server for this project. But.... I didn't keep a backup of the actual data. There was just a lot of data, so I kinda skipped this one I have my script to download and process it, but the page design is hard to find back, and my year of monthly snapshots is gone.
To make matters worse, gz.blockchair.com where I get the data was last updated on November 30, and hasn't updated since. This has happened before and usually they come back, but for now I have no data.
If it takes too long I'll have to figure out how to get this data from Bitcoin Core myself.
If anyone happens to have some old backups, please let me know

[pbies]

To get good list of addresses with balances, I used a script in python.
It is very good to then check other addresses with this file if you need fast solution.
Both files must be sorted, then use "comm -12" to find addresses that are in both files.

Code:

#!/usr/bin/env bash
# apt install aria2
echo Downloading...
aria2c -x4 http://addresses.loyce.club/blockchair_bitcoin_addresses_and_balance_LATEST.tsv.gz
echo Unpacking...
pv blockchair_bitcoin_addresses_and_balance_LATEST.tsv.gz | gunzip > blockchair_bitcoin_addresses_and_balance_LATEST.tsv
echo Sorting...
pv -B 1M -cN input blockchair_bitcoin_addresses_and_balance_LATEST.tsv | cut -f 1 | sort -u --parallel=16 | pv -cN output > addrs-with-bal.txt
echo Done!
>&2 echo -ne "\a"

[LoyceV]

To get good list of addresses with balances, I used a script in python.

That's a long way to turn the list with balances into the list without balances (which I had on my site already). But it doesn't fix the problem that they're still unavailable.

I'm still adding data to my new server, when I'm done, I'll see if I can get this list from Bitcoin Core myself.

[Mek]

I still have the "latest" txt file on my disk, list of addresses without balances. Date modified says 29 Nov 2024. Would that help?

[LoyceV]

I still have the "latest" txt file on my disk, list of addresses without balances. Date modified says 29 Nov 2024. Would that help?

I'd appreciate having it. Any where to download it?
In retrospect, I should have made backups of this too. I will next time, I now regret losing monthly snapshots from the past year.

[Mek]

I still have the "latest" txt file on my disk, list of addresses without balances. Date modified says 29 Nov 2024. Would that help?

I'd appreciate having it. Any where to download it?
In retrospect, I should have made backups of this too. I will next time, I now regret losing monthly snapshots from the past year.

Sure, link sent via PM