List of all Bitcoin addresses ever used - weekly updates work again!

[NecroMortis]

Parse litecoin all addresses usage possible?

[LoyceV]

Parse litecoin all addresses usage possible?

I can do it: make me an offer

[philipma1957]

Hey how much ram do you need to run this with your server?

128gb  or 256gb.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.


I could donate it to you.

[LoyceV]

Hey how much ram do you need to run this with your server?

I recently tested it: the more cores I use for sorting, the more RAM it takes. I tested the difference, and reduced the sorting to only 2 cores. It writes a lot of temp files (on HDD) with 32 GB RAM. I guess I could use 128 or even 256 to speed this up, but I update the large file once a week, so it doesn't matter that it takes a few hours.

I have a threadripper  doing nothing it has  128gb ram would it be better than the server you are using.

I could donate it to you.

Thanks for the offer, but I'm good for now. This server takes about 12 TB of bandwidth per month.

If you want to find a good use for your server: how about using it to run your own block explorer (mempool.space clone) or Electrum server?

[DecipherBTC]

Is this thread still beeing updated?

Thanks.

[LoyceV]

Is this thread still beeing updated?

Yes. Click and see

[BoraxTributary]

Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.

[LoyceV]

Have you considered posting torrents for all these links? Would make downloding faster, and would help ease the strain on your server.

This question pops up once in a while (including your own post about it back in 2021). Short answer: there's no need, and frequent updates are annoying with torrents. Long answer: click All, CTRL-F "torrent".

[RecRanger]

I made a Python library and CLI tool to check this list for addresses in bulk and in other scripts. Check it out on my GitHub: https://github.com/RecRanger/used-addr-check

[LoyceV]

Is this thread still beeing updated?

It looks like the daily updates didn't happen, which means the weekly update had no fresh data. I'm not sure why, I'll check it tomorrow.

Update: it's fixed. It was waiting for another stuck update. The weekly update is running now, this takes a few hours to complete. Thanks for reporting this.

[RecRanger]

Would you consider open-sourcing the code that generates this list? It seems like it would be helpful to the community to have available.

[LoyceV]

Would you consider open-sourcing the code that generates this list?

I don't really see the point. There's not much to it, but you'll need to download a lot of data to use it.
I get the data from Blockchair, extract the files, get the addresses, and sort them. That's it.

[RecRanger]

The download is going at 100 KB/s for me right now. This would be solvable with a better distribution system (e.g., torrents).

If you use torrents to distribute the file, you'd be able to publish an RSS feed which automatically lets people download the latest version if they want to help seed.

[LoyceV]

The download is going at 100 KB/s for me right now.

That sounds like you're downloading from Blockchair, they have speed restrictions. Try my mirror.

This would be solvable with a better distribution system (e.g., torrents).

As long as my (donated) server is only using 20% of it's allowed bandwidth, I won't bother.