[Script] Imgur to TalkImg - automatically fix your broken images

[LoyceV]

the image was only linked (not embedded through the [img] tag)
~
I still think it's worth uploading it, since imgur could delete our images at any time.

Good point, I only downloaded the embedded images, but links might contain some forum history too.

[joker_josue]

I know that. I believe the image was only linked (not embedded through the [img] tag), so it wasn't using the forum proxy. The script looks for all links (embedded or not), so it was trying to upload it anyway.

I still think it's worth uploading it, since imgur could delete our images at any time.

Right... I hadn't thought about that perspective.

What size could be reasonable to allow uploading? Do you think 5MB would be acceptable?
@LoyceV based on your collection, what value do you think is reasonable?

[LoyceV]

What size could be reasonable to allow uploading? Do you think 5MB would be acceptable?
@LoyceV based on your collection, what value do you think is reasonable?

You decide: here's the 10,000 largest images. Check a few of them, and see if they're worth saving. Judging by the file size, I already see a few duplicates.

If you allow images >2.5MB, you shouldn't provide [img]-tags for them, and add a warning that it can only be linked.

[joker_josue]

You decide: here's the 10,000 largest images. Check a few of them, and see if they're worth saving. Judging by the file size, I already see a few duplicates.

If you allow images >2.5MB, you shouldn't provide [img]-tags for them, and add a warning that it can only be linked.

Yeah... I think it's better to guarantee the limit, for a better forum experience.
Larger images are linked by the forum as external links/files, so each one manages this as they see fit.

Perhaps if in the future I manage to add some warning element in this regard, I will try to do so.

[TryNinja]

Imgur images are broken again! Feel free to use the script if you haven't already.

[STT]

Is that a 138meg .gif       As awesome as I think memes are, I think we can leave behind file formats from 1987 (36 years old in 9 days) that have been superseded.  Definitely deserves a cap, Imgur I had thought did this a while back but not retrospectively perhaps; probably its showing up as an disproportionate load to bear.

[LoyceV]

Is that a 138meg .gif       As awesome as I think memes are, I think we can leave behind file formats from 1987 (36 years old in 9 days) that have been superseded.  Definitely deserves a cap, Imgur I had thought did this a while back but not retrospectively perhaps; probably its showing up as an disproportionate load to bear.

The fact that it's 36 years old and still in use, means it's a good thing to keep. I recently tested it, and for the right images it still produces smaller files than .png. So let's keep .gif

[joker_josue]

Is that a 138meg .gif       As awesome as I think memes are, I think we can leave behind file formats from 1987 (36 years old in 9 days) that have been superseded.  Definitely deserves a cap, Imgur I had thought did this a while back but not retrospectively perhaps; probably its showing up as an disproportionate load to bear.

The fact that it's 36 years old and still in use, means it's a good thing to keep. I recently tested it, and for the right images it still produces smaller files than .png. So let's keep .gif

And don't forget that GIF is a framed image file, which is used to create moving images. So it turns out to be a different file type than a PNG or JPEG.

Now, speaking of history... 
JPEG was created in 1992
And PNG was created in 1996

Another curiosity is that the PNG was created because of copyright issues with the GIF. The GIF files had used the LZW compression technique which was patented by another company. This has led to many companies having to pay to use GIF files. Only private individuals or non-profit institutions could use the GIF without paying.

That happened in 1994. At the time, GIF was the most used type of image on the internet, it took up less space than JPG and had adequate quality for the time. All this patent problem, motivated several developers to work on a new image format, which was able to compress images more and with better quality, the PNG. The next step was for browsers to accept this new format, which thanks to Microsoft and Netscape, with their browsers, made PNG become popular on websites.

At that time, two interesting online movements emerged:
"Burn All GIFs" - What motivated people to stop using the GIF and how to send thousands of emails to the company that had the patent.
"PNG's not GIF" - Which motivated people to use PNG instead of using GIF.

In 2004 the patent ceased to be valid and everyone can freely use GIFs.
Perhaps this was one of the first moves against patent lobbying done online.

[yahoo62278]

Just spent the last 2 and a half hours running the script. 506 pages later and my images appear to have reappeared lol. Great job @TryNinja everything worked great.

Also want to say thank you to joker_josue for talkimg as that's the image site I used.

[dragonvslinux]

Just used this script (better late than never I figured) and can also say it worked very well. Quite a lot of API rate limiting pauses but I guess this is to be expected using the key provided, or in general maybe. Ideally there would have been an option to ignore all images I've posted to Wall Observer, as that would have saved most of the work, but the script got the job done in the end regardless.

There were also some instances of images being uploaded, but then due to locked topic no post was edited, I assume this is where you are the OP you locked the topic maybe? I didn't generally find this happened with images in locked topics overall, just a few instances. Even when re-running the script it would still re-upload the images but be unable to edit the post... maybe this has already been discussed though.

[LTU_btc]

Tried to run script, everything worked fine for about 30 minutes, got API rate limits message few times and then script got stuck at 87%:

Will try to run script again tomorrow, though most of remaining images isn't relevant anymore

[dragonvslinux]

Is it possible that this script would work for tradingview images as well if I changed imgur to tradingview? I noticed a lot of these disappeared out of older topics around the same time as the imgur situation, whereas the images themselves are still available via TV. I assume it'd be imageLinkRegex and decodeProxyImages lines of code that needs changing if so?

The strange thing is TV images are still working on the forum, but it seems that images prior the changes have been affected nonetheless, so ideally it'd also only change the broken ones.

[joker_josue]

Tried to run script, everything worked fine for about 30 minutes, got API rate limits message few times and then script got stuck at 87%:

Weird... I don't have any limits imposed on uploading. 
If you experience this type of situation again, let us know.

[LTU_btc]

Tried to run script, everything worked fine for about 30 minutes, got API rate limits message few times and then script got stuck at 87%:

Weird... I don't have any limits imposed on uploading. 
If you experience this type of situation again, let us know.

Today I tried to run script again to replace remaining images and now everything worked fine, remaining images were replaced just in few minutes. Have no idea why scripto stopped yesterday.
@TryNinja, thanks for this script, without it I wouldn't bother to replace my images manually.

[joker_josue]

@TryNinja
Can I use your proxy for an add-on I'm developing for the project?

_{I still haven't managed to overcome that JSON issue...}

[TryNinja]

@TryNinja
Can I use your proxy for an add-on I'm developing for the project?

_{I still haven't managed to overcome that JSON issue...}

Of course! Go for it.

[joker_josue]

@TryNinja
Can I use your proxy for an add-on I'm developing for the project?

_{I still haven't managed to overcome that JSON issue...}

Of course! Go for it.

Thanks! I didn't want to abuse it.

Soon we will have something new, which I believe will be something that everyone will like.

[Pmalek]

Hi TryNinja,
I tried the script today and it works really well. After a quick check, it seems to have replaced all my old Imgur images with new TalkImg links.
I was wondering if there is a quick way to add new image hosts to the code? A few years ago, I used vgy.me for images in some of my threads. Perhaps the script could be used to automatically replace those links as well. 

[joker_josue]

Hi TryNinja,
I tried the script today and it works really well. After a quick check, it seems to have replaced all my old Imgur images with new TalkImg links.
I was wondering if there is a quick way to add new image hosts to the code? A few years ago, I used vgy.me for images in some of my threads. Perhaps the script could be used to automatically replace those links as well.  

As far as I know, just change the host address and the result will be the same. Try adjusting this line:

Code:

const imageLinkRegex = /https:\/\/i\.imgur\.com\/.*?\.(png|jpg|jpeg|gif)/gi

I don't know if it works on this host, but I know it worked on others. Try it.

[Pmalek]

As far as I know, just change the host address and the result will be the same. Try adjusting this line:

Code:

const imageLinkRegex = /https:\/\/i\.imgur\.com\/.*?\.(png|jpg|jpeg|gif)/gi

I don't know if it works on this host, but I know it worked on others. Try it.

Let's wait for TryNinja just in case. I guess the API key needs to be updated as well. If you use imgbb, you need to edit the API key in the code and enter your own. The API code is already set by default for your site, TalkImg, but it can also be edited. vgy.me surely has unique API codes as well.