[back on new server] List of all Bitcoin addresses with a balance

[LoyceV]

My bandwidth usage was increasing again, which means more and more users realized I still offer a direct download for the latest version if you use the date instead of "LATEST" link. And instead of adopting the Torrent download, my outgoing bandwidth was pushed to a TB per day again.
So I've implemented my first automated IP-DROPs. I won't post the exact specs, and I'll probably have to fine-tune this later, but if you just use the Torrent for daily downloads, the occasional manual download shouldn't be a problem.
However, if you push your luck:

Code:

iptables -A INPUT -s <your IP here> -j DROP

My outgoing bandwidth instantly dropped by about 80%.

[pbies]

Torrent is enough for me.

I stopped the auto-download script for each half an hour (did I?) each day.

[Vod]

I was watching live when the flipover happened about 3 mins to midnight.   My torrents paused and then were replaced with the newer one.

I'm the first seeder after initial but no other clients yet.   The one from yesterday only uploaded around 300MB.

[Mek]

I had the same experience. I downloaded the torrent, seeded whole day, but I saw only me and one other client (the seeder I was downloading from). No upload from me. Seems like people are not interested.

[LoyceV]

I was watching live when the flipover happened about 3 mins to midnight.   My torrents paused and then were replaced with the newer one.

I have 2 servers running this (one to upload, one to test the download and seed it). Both get a Seed Ratio of only about 2-5 on most days. With higher demand I expect this to go up a bit, but if all downloaders also seed, it shouldn't become a bandwidth problem anymore.

Here's my quick and dirty for deleting older files:

Code:

rm $(ls Bitcoin_addresses_*.txt.gz | head -n -1)
rm $(ls blockchair_bitcoin_addresses_and_balance_*.tsv.gz | head -n -1)

Seems like people are not interested.

If this removes the people who just download this out of habit without needing it, that's okay with me
Yesterday. I DROPped 71 IP-addresses (for wasting my bandwidth). Today, there are 13 more on my list. I can literally see the moment I implemented this on my bandwidth graph

[Vod]

You were late tonight LV...

[LoyceV]

You were late tonight LV...

The source data isn't always available at exactly the same time. Sometimes it even skips a day.
I should create my own from Bitcoin Core's chainstate directory, but I think that requires shutting down Bitcoin Core every day.

The "bandwidth abusers" are back: I've DROPped more than 50 IPs since yesterday. I'll see if they run out of IP-addresses before I run out of bandwidth. There's currently about 250 Mbit/s leaving this VPS.

This is where you lost me. I have no idea how to do "interactive" websites.

I can help you with that.

What options do I have here? This should solve the abuse problem:

The problem is that I have no idea how to implement this. $1 for a token valid for 1 year or 1 TB bandwidth (whichever is reached first) would stop abuse and is cheap enough. I could also give away tokens to anyone who asks for it.

[NotATether]

I have just started seeding the torrent. From a seedbox, so no bandwidth issues to worry about.

I'm not exactly sure how I will know when my copy is 100% downloaded though.

[LoyceV]

I'm not exactly sure how I will know when my copy is 100% downloaded though.

I use this:

Code:

transmission-daemon --incomplete-dir ~/addresses.loyce.club/incomplete --download-dir ~/addresses.loyce.club

When it's complete, it's moved to a different directory.

[runlola]

Looks like this is a fast mirror: https://privatekeyfinder.io/assets/downloads/blockchair_bitcoin_addresses_latest.tsv.gz

[LoyceV]

Looks like this is a fast mirror

It's fast, but the data is from October 10.

[LoyceV]

Stats
Since I started DROPping IP-addresses, I had blocked 354 of'm. I guess my DROP rules are a bit strong, and I want to give people the chance to switch to Torrent, so I wiped the list. But, my DROP script still uses logs from the past days and weeks, so any recent abusers will quickly be DROPped again. I'll probably do the same next month.
My monthly bandwidth usage was now 8 TB, that's 50% of what this server is allowed. The number of torrent users is still very disappointing.

Right after dropping my DROP rules, my outgoing bandwidth shoots up, so many bots must have been trying to download long after I blocked them.

Different IP-addresses are all sending a HEAD request for yeasterday's data 4 times in a row:

Code:

IP - - [29/Oct/2026:08:55:05 +0100] "HEAD /blockchair_bitcoin_addresses_and_balance_October_28_2026.tsv.gz HTTP/1.1" 200 305 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36"
IP - - [29/Oct/2026:08:55:05 +0100] "HEAD /blockchair_bitcoin_addresses_and_balance_October_28_2026.tsv.gz HTTP/1.1" 200 305 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36"
IP - - [29/Oct/2026:08:55:05 +0100] "HEAD /blockchair_bitcoin_addresses_and_balance_October_28_2026.tsv.gz HTTP/1.1" 200 306 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36"
IP - - [29/Oct/2026:08:55:05 +0100] "HEAD /blockchair_bitcoin_addresses_and_balance_October_28_2026.tsv.gz HTTP/1.1" 200 306 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36"

It looks like someone shared a faulty script.

[pbies]

@LoyceV

I would allow 3 downloads of one file, then block and release after next update.

If you could be able to do such.

I am using torrent with success so just putting an advice.

[Vod]

I would allow 3 downloads of one file, then block and release after next update.

Torrents send part of files at a time - you can't actually track what files were shared completely, but you can see how much data you have uploaded.

[LoyceV]

I would allow 3 downloads of one file, then block and release after next update.

Do you mean in total? That would mean 3 bots download the file within minutes, and anyone who occasionally visits my site can't use it.
So far the current restrictions work okay in terms of bandwidth. If it stays like this, I can even ease them a bit.
But what I'd really like to see is more torrent downloads. There were hundreds of daily downloads before, and now just a few torrent downloads. If that would be a few hundreds too, the download speed would be much better.