List of all Bitcoin addresses ever used - weekly updates work again!

[NecroMortis]

Parse litecoin all addresses usage possible?

[LoyceV]

Parse litecoin all addresses usage possible?

I can do it: make me an offer

[philipma1957]

Hey how much ram do you need to run this with your server?

128gb  or 256gb.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.


I could donate it to you.

[LoyceV]

Hey how much ram do you need to run this with your server?

I recently tested it: the more cores I use for sorting, the more RAM it takes. I tested the difference, and reduced the sorting to only 2 cores. It writes a lot of temp files (on HDD) with 32 GB RAM. I guess I could use 128 or even 256 to speed this up, but I update the large file once a week, so it doesn't matter that it takes a few hours.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.

I could donate it to you.

Thanks for the offer, but I'm good for now. This server takes about 12 TB of bandwidth per month.

If you want to find a good use for your server: how about using it to run your own block explorer (mempool.space clone) or Electrum server?

[DecipherBTC]

Is this thread still beeing updated?

Thanks.

[LoyceV]

Is this thread still beeing updated?

Yes. Click and see

[BoraxTributary]

Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.

[LoyceV]

Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.

This question pops up once in a while (including your own post about it back in 2021). Short answer: there's no need, and frequent updates are annoying with torrents. Long answer: click All, CTRL-F "torrent".

[RecRanger]

I made a Python library and CLI tool to check this list for addresses in bulk and in other scripts. Check it out on my GitHub: https://github.com/RecRanger/used-addr-check

[LoyceV]

Is this thread still beeing updated?

It looks like the daily updates didn't happen, which means the weekly update had no fresh data. I'm not sure why, I'll check it tomorrow.

Update: it's fixed. It was waiting for another stuck update. The weekly update is running now, this takes a few hours to complete. Thanks for reporting this.

[RecRanger]

Would you consider open-sourcing the code that generates this list? It seems like it would be helpful to the community to have available.

[LoyceV]

Would you consider open-sourcing the code that generates this list?

I don't really see the point. There's not much to it, but you'll need to download a lot of data to use it.
I get the data from Blockchair, extract the files, get the addresses, and sort them. That's it.

[RecRanger]

The download is going at 100 KB/s for me right now. This would be solvable with a better distribution system (e.g., torrents).

If you use torrents to distribute the file, you'd be able to publish an RSS feed which automatically lets people download the latest version if they want to help seed.

[LoyceV]

The download is going at 100 KB/s for me right now.

That sounds like you're downloading from Blockchair, they have speed restrictions. Try my mirror.

This would be solvable with a better distribution system (e.g., torrents).

As long as my (donated) server is only using 20% of it's allowed bandwidth, I won't bother.

[LoyceV]

This data is back online!
After my sponsored dedicated server disappeared, I had to restore data on a new server. Everything including weekly updates should be working again, please let me know if anything fails.

The data
See alladdresses.loyce.club

1. All Bitcoin addresses ever used, in chronological order, without duplicates.
all_Bitcoin_addresses_ever_used_in_order_of_first_appearance.txt.gz: (Warning: 36 GB)

2. All Bitcoin addresses ever used, sorted by address, without duplicates.
all_Bitcoin_addresses_ever_used_sorted.txt.gz: (Warning: 32 GB)

Updates
Updates happen on Tuesday!

Bandwidth
This server can use unlimited bandwidth, at 250 Mbit/s. If things get crazy, I may have to resort to using torrents.

[LoyceV]

Quoting myself here because it's relevant:

It was brought to my attention that my "sort" is "different" now, and I got these results testing:

Code:

cat Bitcoin_addresses_LATEST.txt.gz | gunzip | sha256sum
df0baad2301e9b897a02bd3fccb115968c82eb3956143e2f5b4c3ad7b2c227bf  -

So far so good.
Now, this file is sorted on my server from a cronjob. But when I sort it on my local computer, I get this:

Code:

cat Bitcoin_addresses_LATEST.txt.gz | gunzip | sort -S20% | sha256sum
27c2541369d0546ec7c7e70d09d807d8fc6d39435f8857e5ebbf8386584be2d2  -

Has anyone else noticed an incompatible sorting method? Should I change this to a different sorting? Or would that break scripts from people who are currently using it?

[giacoro]

Some interesting (?) statistics
Total address count: 1,484,589,749
1... address count: 1,039,899,708
3... address count: 343,485,961
bc1q... address count: 55,006,904
...-... (with a "dash") address count: 46,197,161

Unique address count: 693,180,830
1... address count: 470,943,308
3... address count: 167,941,821
bc1q... address count: 39,137,878
...-... (with a "dash") weird address count: 15,157,808

How can you generate an address with a dash inside?

[LoyceV]

How can you generate an address with a dash inside?

You can't, it doesn't exist:

Q&A

Can you please clarify, what is the type of these d- and s- addresses?

This is how Blockchair.com shows OP_RETURN.

[mg24680]

Any chance you could please repost

     freshly_downloaded_Bitcoin_addresses_in_original_order_20250106.txt

if you still have it available?

[LoyceV]

Any chance you could please repost
     freshly_downloaded_Bitcoin_addresses_in_original_order_20250106.txt
if you still have it available?

I don't have it anymore, it's included in all_Bitcoin_addresses_ever_used_in_order_of_first_appearance.txt.gz (36 GB) now. I'm curious: what do you need this file for?

The file is easy to reproduce, here you go: freshly_downloaded_Bitcoin_addresses_in_original_order_20250105.txt (20 MB) (scheduled to be deleted in 14 days).