I had used AWS as an example because I believed you used it for some of your other projects.
Correct, loyce.club runs on AWS (sponsored).
Yes, transferring data to the internet is very expensive. You can use a CDN (content delivery network) to reduce costs a little bit. 5 TB of data is a lot.
I highly doubt I'd find a cheaper deal
![Cheesy](https://bitcointalk.org/Smileys/default/cheesy.gif)
I hope not to use the full 5 TB though, I expect some overselling and don't want to push it to the limit.
I think you are proving my point. The more input you have, the more time it takes to process one additional input.
An exponential increase in processing time is to be expected. I consider the increase acceptable for scaling: if the number of addresses is 5 times larger than it is now (20 years from now?), it takes only 6 times more processing power.
The longer the list, the longer it will take to sort one additional line.
At some point a database might beat raw text sorting, but for now I'm good with this
![Smiley](https://bitcointalk.org/Smileys/default/smiley.gif)
Your local ISP might not like it very much if you are uploading that much data.
I should add a storage VPS to my shopping list. I now indeed have to transfer a large amount of data through my local internet, and it's terrible compared to server performance.
I meant on a VPS with another cloud provider with unmetered traffic, such as Hetzner.
I'm not using anything with "unmetered" traffic.
Still working on restoring all data from scratch. I'm curious to see if it matches any of the 2 existing files.
I don't really get the focus on data traffic though, right after
I got a good deal on a new VPS. I'm good for now
![Smiley](https://bitcointalk.org/Smileys/default/smiley.gif)
I was under the impression that traffic out of the AWS network (for AWS) will count as egress traffic, and will be billed accordingly.
AWS charges $0.09/GB, and especially since this one is sponsored, I don't want to abuse it. I love how stable the server is though, it has
never been down.