So you are just assuming most of the people are using wInD0ws 0S? How about tutorials for Mac and Linux users?  I'm assuming you didn't assume he may be assuming Linux users don't need a tutorial I mean: 2 lines vs 4 pages  |
|
|
|
Tell me something (you thought you already said it, but remember), how much does that 800k occupy? It's 143 GB. It could have some cleaning, like the 30k images that only say "removed", but I hardlinked all duplicates to the same file already, so it doesn't take much diskspace. |
|
|
|
Update:Starting point to avoid loading the large index page: Trust list for: Timelord2067 (Trust: +14 / =11 / -0) (1081 Merit earned) (Trust list) (BPIP). New or Wiped Trust lists in the past week:
|
|
|
|
Actually, thinking about this more carefully, why even do this through TalkImg at all? Maybe it makes more sense to set up some dedicated hosting to serve those images without entangling them with TalkImg? I'm not sure who wants that challenge, but working on the problem in isolation will probably lower (and mostly fix) the costs, which might make it easier to find financial support. A subdomain of talkimg could be on another webhost (that keeps the DNS responsibility in one place), say the ".m" that imgur uses most of the time. A €5.99/month or double this $58.88/year budget webhost will (probably) be enough, and since the amount of storage if fixed I expect hosting costs to go further down in the future. The only reason I'm not doing this myself is because I don't want to deal with copyright takedown requests. |
|
|
|
But my system doesn't rewrite an existing zip. It always creates a new one, with the new name, containing the new images since the last execution of the task (7 days). I assumed nothing less  It's just me being thorough: always make sure a new backup can't accidentally overwrite your old backup and destroy your only copy. |
|
|
|
1 - In this case of making the weekly backup, it will make the complete backup everytime, right? Would it be possible to backup only the new files of that week, or do you have to download everything again every week? I may be wrong, but joker_josue always updates all 3 links,you can see that from the filenames (they have the date of when the backup is made). In that case you will always have new files with new information. Since the backups include the new images from the previous week, you will always have to download the new .zip files that are posted on the url provided. If you run the same wget command again right after downloading, does it redownload everything? If so, you should add the "-c" option: -c
--continue
Continue getting a partially-downloaded file. This is useful when
you want to finish up a download started by a previous instance of
Wget, or by another program. I use this on Linux in a cronjob: #!/bin/bash
cd /data/backup_talkimg
sleep $(( $RANDOM % 22 ))h; sleep $(( $RANDOM % 59 ))m # Random time each day
wget -q --no-parent -rcA.zip https://www.talkimg.com/tempbackups/ There's one flaw: if joker_josue would replace an old .zip by something else with the same name, it would overwrite my local file. But my local "Time Machine" backups make sure I won't lose files that way. I use a random time to spread server bandwidth. It takes only a second to run again, so it doesn't matter to use daily checks for new data.
Lol@Windows task scheduler. So much more complicated than a cronjob  |
|
|
|
If the image proxy keeps served images cached for a period of time, bandwidth probably won’t be an issue. But if the image proxy queries the storage bucket every time someone accesses the image, egress charges will quickly add up. Caching is up to the browser, so it's a per-user thing: The image proxy isn't a caching proxy. Proxied images are never saved to disk, and only small chunks of images are stored in memory at any one time. The proxy does work with client-side caching (it passes on appropriate cache-related headers, etc.), so you may cache images. |
|
|
|
I found one here: loyce.club/badposts/spam.html, and it got edited after posting. Original: As an AI language model, I cannot predict the future or provide financial advice. Altcoin season typically refers to a periThe market cycles of cryptocurrencies are highly unpredictable and influenced by a variety of factors, including market sentiment, adoption, and regulatory developments. It is important to conduct your own research and consult multiple sources before making any investment decisions. Current: Altcoin season typically refers to a periThe market cycles of cryptocurrencies are highly unpredictable and influenced by a variety of factors, including market sentiment, adoption, and regulatory developments. It is important to conduct your own research and consult multiple sources before making any investment decisions. The user has a neutral tag about it already, but hasn't been banned. It looks like 18 posts have been deleted already, but the user is still spamming. |
|
|
|
You have gathered 800k from a hosting, let's imagine that there are more than 800k together with the other services. Which indicates 1600k images listed from the forum. Let's round it up to 2000k images. I count about 2.5 million image links in my data collection. Some of those are dead already, so your estimate is close enough. But even a VPS has file limits. The service you use goes up to 58,000,000!?  The "58 million" is the number of inodes on a 1 TB disk. Most files aren't that small, so the number of images you can fit in 1 TB will be significantly lower. So in most cases, the number of files shouldn't be a problem before you run out of diskspace. AWS S3 is really the most cost-effective option. I did a quick price check: First 50 TB / Month: $0.023 per GB AWS is very reliable, but quite expensive on bandwidth. 10 TB doesn't sound unrealistic, and would cost $230 per month. Contabo (I think TryNinja still uses this) gets you 32 TB bandwidth for €17.49 per month. And unlike AWS, that includes the rest of the server too. But it probably won't reach the same very high uptime AWS has. |
|
|
|
Lol: "an exchange with what appears to be an inbuilt mixer for inbound/outbound transactions" Every exchange, casino and bank (!!) is a "mixer" to the outside world. Not all information has to be public. |
|
|
|
So, what happened to this? I can't even load your clearnet website in Tor browser, because of "Performance & security by Cloudflare"... I've been looking at various rotating circles for about 10 minutes now. Once in a while Cloudflare shows it's (tracking) captcha, but it never completes.
You can't provide privacy while using Cloudflare.
Cloudflare, we use dns server and DDoS protection. Certificates, as you can easily see, have nothing to do with them. There are a few more things that I would like to tell you, but unfortunately I can only do this in personal correspondence and only to you, since it seems to me that you are one of those people that you can rely on. Feel free to PM me. |
|
|
|
Right now I can have around 600k files, a very comfortable number for the next months/years. I see. That's tiny For comparison: a "normal" filesystem on a 1 TB disk has 58 million inodes (which means it could handle that many small files). You know that hosting services talk about unlimited, but there is always some kind of limit. I preferred to have unlimited disk space and bandwidth. I learned a long time ago to stay away from "unlimited". I prefer to know what I get. So entering 800k files now would require a new server upgrade. And I didn't want to do that now. But, I'm checking several options that can make everything viable, without having to do a new upgrade. Therefore, what I ask now is patience to be able to support this type of action. I am studying what I can do to accommodate these images. I used to use shared hosting, until my last one disappeared. Since then, I've become much more comfortable with VPS servers, which in general give better specs for money, but don't come with a pre-installed selection of scripts. |
|
|
|
You can look at my data to get an idea.  That's only recent images, I'm curious how often old images are downloaded too. I don't mind receiving the images, but at the moment I can't receive 800k all at once. We had to be selective.  Unfortunately, being selective doesn't work to replace all links. |
|
|
|
And in terms of bandwidth, how do you handle that? I don't: I don't want to have to deal with possible copyright issues  Maybe theymos can share how much bandwidth the image proxy consumes in total. |
|
|
|
|
For me, the most demotivating thing when it comes to reporting is if the offending user isn't properly dealt with. Therefore I now add more and more shitposters or chatbot plagiarism spammers to Ignore. That means I only report them once, and if they aren't banned, I don't waste my time on them anymore.
|
|
|
|
no one follows a forum for 3 years and doesn't register. Of course that's possible. For instance, I've been using Stack Overflow for as long as I can remember. There's no need to register to read, and if sites start demanding registration, I usually just stop using them. |
|
|
|
It should be treated the same as plagiarism. Agreed! You're a Global Mod, so why isn't nesty banned yet?I think theymos should probably make an announcement about prohibiting this sort of use of AI or at the very least we add it to the "unofficial" forum rules but users should be alerted not to use it in such a way. Isn't this already covered by the unofficial forum rules? 33. Posting plagiarized content is not allowed. Let's look at the definition: Plagiarism
the process or practice of using another person's ideas or work and pretending that it is your own I've reported one of this posts again: Bounty spammer uses chatbot plagiarism to spam the forum. Please ban. |
|
|
|
Message I am fathafraink (bitcointalk.org #1130411),
hereby certify bc1qfwayk2wxg5fl2tsu5n3xwq3xmdjacpk397cwav as my Bitcoin address. Address bc1qfwayk2wxg5fl2tsu5n3xwq3xmdjacpk397cwav Signature IB569gBYvIijgYwMolUDwf3EeXjF4F/mkmnbwDgrA+bZUcZOdqYbgG70uHk1h0LzHr5V85No8kWsbIeepl7AeP0= Quoted and verified. hello, im PytagoraZ from bitcointalk. this is my bitcoin wallet bc1q269p5yuekmv9fkdhhhtlg828dn9eeguu422nx8 this sign created 08 june 2023 address: bc1q269p5yuekmv9fkdhhhtlg828dn9eeguu422nx8 Gignature: H3aDNc2hqB3d+zq4GJFX/3EkiusVnfLwTTMPLKWZJSCpVanvGWgtJN9sG82aVB10MVnZUn0jx5ObbleXYdDfNtk= Quoted and verified. |
|
|
|
|
Show Posts
