[Script] Imgur to TalkImg - automatically fix your broken images

[TryNinja]

Imgur to TalkImg - automatically fix your broken images

Imgur images don't work anymore, so you probably have lots of posts with broken images that look like this:



For context: Imgur images suddenly became invalid?


So I created a script that:

1. Goes through all your posts looking for imgur.com direct links (.png|.jpg|.jpeg);
2. Reuploads the image to talkimg.com (or imgbb);
3. Edits the post with the new link.

How to use it:

1. Choose the image provider you want to use (change provider to imgbb or talkimg - IMPORTANT: all lower case).
2. If you choose imgbb, you need an account and your own API key. Generate your API key here and put it on providers -> imgbb -> apiKey (example).
3. Go to bitcointalk.org (any page).
4. Open the browser developer tools on the Console tab (Ctrl+Shift+I or F12).
5. Paste the script and press Enter.
6. Leave the page open while the script runs and, if you can, do not use the forum (not even in other tabs) to avoid rate limiting errors.

If a error shows up, please report it here and/or run the script again (the process will start over, but already updated posts will be ignored since they won't have any more imgur.com links).

Script:

- If you're using TalkImg, you are free to swap the API key to your own if you have an account there. Otherwise, there is already one provided by @joker_josue for this script.
- You can change the startPage variable if you want to start the script from a specific page (i.e the script errors at page 300 and you want to restart back from there).

GET THE SCRIPT CODE HERE: https://gist.github.com/ninjastic/36c14fb2eb1c4b750f40f332d408688f

"Single Topic" version

Get the code here: https://gist.github.com/ninjastic/59bde80306c32153a5775b9a570b16b7

Run it on any topic and all images posted by you will be updated.

IMPORTANT: only images that are shown on the screen! This means that if you are on page 1, the script won't update the images on page 2. You can use the ;all page on the forum to make all posts show up all at once (probably won't work properly if the topic is huge?).

Other notes:

- This will upload and edit all imgur.com links found on your post history (even those inside quotes you made of other people).
- Posts on locked topics can't be edited, so the recently uploaded images for them will be deleted (to save space on the talkimg server).
- TalkImg max size limit is 2 MB, so some images may fail.


If you have broken bbcode resulted from an old version of the script, run this fix: https://gist.github.com/ninjastic/d560848568339e5a2d7a25ddffb578d5

[cygan]

i have now started the script and run it completely
but when i visit this thread of mine the images still don't show up and the imgur error message is displayed...
the script should replace these imgur links with the new TalkImg links, or did i misunderstand something here

[Charles-Tim]

I tried it too, first and second time on Chrome, later on Microsoft Edge. I saw finished too and I checked my topic pages history, the images are still not showing.

[decodx]

Hey TryNinja, first of all, thanks for putting in the effort to create this script. However, I don't think I'll be using it. No offense, but I'm not very experienced with coding or using developer tools in the browser, and I'm not comfortable with the idea of a script altering my posts. It's not that I don't trust you, but I don't trust myself to not mess up something. 

Can we make the process less automatic for members who prefer to manually edit their old posts? I had an idea that you or LoyceV might be able to assist with. For instance, adding a search function for posts with images or Imgur links to ninjastic.space would make it easier for members to manually locate and edit their old posts without relying on an automated script. This could be an additional parameter in the search settings that only displays posts with images. Do you think this would be possible?

[Timelord2067]

Thanks for this work around.  How do I set a specific folder for these legacy images?

[LoyceV]

Can we make the process less automatic for members who prefer to manually edit their old posts? I had an idea that you or LoyceV might be able to assist with. For instance, adding a search function for posts with images or Imgur links to ninjastic.space would make it easier for members to manually locate and edit their old posts without relying on an automated script.

To add to this feature request: I've downloaded 796k images from imgur so far (and I'm almost done with all images from my archived posts). I could create one zip-file per userID with all their images. All you'd have to do is find the name given by imgur. I can probably make a list of posts too, but I think TryNinja can do that much faster (and on demand).

[BitcoinGirl.Club]

Did you make talkimg.com server busy?



I am assuming a lot of data are now uploading by the script to their server and it's like a ddos attack for them LOL

Script:

I am on Firefox using the TOR connection. But interestingly I can not copy and paste the code even anything to my console. What is the mystery?

[Charles-Tim]

I am assuming a lot of data are now uploading by the script to their server and it's like a ddos attack for them LOL

I have just uploaded an image twice on the site and it is working fine. Upload another image because maybe the image you wanted to upload is not of supported format.

[Timelord2067]

Thanks for this work around.  How do I set a specific folder for these legacy images?

I decided to go ahead and get things started.  I swapped out the API for the one I have on my account.  After 185 pages without any activity, this happened:



...and the script stopped.

[joker_josue]

Did you make talkimg.com server busy?



I am assuming a lot of data are now uploading by the script to their server and it's like a ddos attack for them LOL

Incidentally, not so many images have entered since the script was published that could cause this.

Either way, with so many requests, there may be moments of instability. But for now it continues to work normally.




Thanks again to TryNinja for this script, which will certainly be of help.

But, I also ask for understanding for the fact that I had planned a gradual growth, and not a sudden growth due to a similar service going out of business. 
Believe me, I've been making every effort to keep things running, and I'm already planning to reorganize the server.

So far I've managed to keep everything working. Therefore, I appreciate your understanding if there are moments of instability (which I believe were very rare). 

[pawanjain]

Thanks for this work around.  How do I set a specific folder for these legacy images?

I decided to go ahead and get things started.  I swapped out the API for the one I have on my account.  After 185 pages without any activity, this happened:



...and the script stopped.

How did you get the API key ?

I tried to search for it on the site and even tried to register but couldn't see any options for it anywhere on the site.
I tried running the script in OP but it didn't change any of the images although the script completed without any errors.
So I thought of registering on the site and using it's API and then try running the script.

[Timelord2067]

There's already an embedded API key so you don't need to use your own. hOWEVER  if you have contacted Joker to ask to register, then you can get an API key in the settings section.

[NeuroticFish]

I didn't look into the script, I just tried to run it by the instructions.
Well... I've got errors like the one from the linked image and... the posts to be edited seem to be TryNinja's

I guess that it still needs a little work, however, I do like the idea and I appreciate the effort (hence the merit).

PS. Does this also cover the parts of the forum I've posted in the past and now I have them ignored?

[libert19]

For those who want to run this script on android device can use Eruda browser to do so. Click three dot browser at top right >> run code >> paste script in console.

https://www.talkimg.com/ss.png

[NeuroticFish]

I will come back to the error I've noticed.
I've seen in the script a part that writes "https://bitcointalk.org/index.php?action=profile;u=557798", which is TryNinja's profile.
The next line is fetching data from there. So yeah, I guess that everybody is trying to copy TryNinja's images  

PS. After changing in the script his user id with mine I stopped getting that error.

[TryNinja]

I've seen in the script a part that writes "https://bitcointalk.org/index.php?action=profile;u=557798", which is TryNinja's profile.
The next line is fetching data from there. So yeah, I guess that everybody is trying to copy TryNinja's images  

Yes, forgot to remove my uid from the URL.

It should work now.

PS. Does this also cover the parts of the forum I've posted in the past and now I have them ignored?

I'm not sure. Only if they show up on your post history.

edit: ignored boards don't show up, so they aren't covered.

Can we make the process less automatic for members who prefer to manually edit their old posts? I had an idea that you or LoyceV might be able to assist with. For instance, adding a search function for posts with images or Imgur links to ninjastic.space would make it easier for members to manually locate and edit their old posts without relying on an automated script. This could be an additional parameter in the search settings that only displays posts with images. Do you think this would be possible?

Sure, I'll see what I can do.

I am on Firefox using the TOR connection. But interestingly I can not copy and paste the code even anything to my console. What is the mystery?

You need to type "allow pasting" on the Console (notice the alert under the Console tab).


I also decreased the limit from 30 uploads/minute to 20 uploads/minute to hopefully get a lower load on @joker_josue's server.

[BitcoinGirl.Club]

I am on Firefox using the TOR connection. But interestingly I can not copy and paste the code even anything to my console. What is the mystery?

You need to type "allow pasting" on the Console (notice the alert under the Console tab).

It's working!!!



465 is the number of images I posted so far on the forum using imgur?
If feels like not even close to what I think the real number should be out of 9815 total posts LOL

[TryNinja]

465 is the number of images I posted so far on the forum using imgur?
If feels like not even close to what I think the real number should be out of 9815 total posts LOL

It's the number of pages you have on your post history (minus ignored boards, maybe? because I see you actually have 491 pages).

Could you check how many pages you see? https://bitcointalk.org/index.php?action=profile;u=662330;sa=showPosts

[BitcoinGirl.Club]

465 is the number of images I posted so far on the forum using imgur?
If feels like not even close to what I think the real number should be out of 9815 total posts LOL

It's the number of pages you have on your post history (minus ignored boards, maybe? because I see you actually have 491 pages).

Could you check how many pages you see? https://bitcointalk.org/index.php?action=profile;u=662330;sa=showPosts

I get caught on the ignore boards in many occasions so far. Yes I have many boards are on ignored and with ignored boards total number of pages are 465. When I am checking it from none logged in browser then I see it's 491. I don't care about the ignored boards though LOL

Thanks for clarification. I was thinking those were number of images.

[edit]
I got error
Cross-Origin Request Blocked: The Same Origin Policy disallows reading the remote resource at https://talkimg.com/image/UUGNf/delete/eb7edff665a1505b793b77cfb76374db770c993d2420a8d6. (Reason: CORS header ‘Access-Control-Allow-Origin’ missing). Status code: 200.
The learn more link: https://developer.mozilla.org/en-US/docs/Web/HTTP/CORS/Errors/CORSMissingAllowOrigin?utm_source=devtools&utm_medium=firefox-cors-errors&utm_campaign=default

Followed by the following
Uncaught (in promise) TypeError: NetworkError when attempting to fetch resource.

Code:

<anonymous> debugger eval code:172
    AsyncFunctionNext self-hosted:810
    (Async: async)
    <anonymous> debugger eval code:172
    getEvalResult resource://devtools/server/actors/webconsole/eval-with-debugger.js:251
    evalWithDebugger resource://devtools/server/actors/webconsole/eval-with-debugger.js:172
    evaluateJS resource://devtools/server/actors/webconsole.js:960
    evaluateJSAsync resource://devtools/server/actors/webconsole.js:851
    makeInfallible resource://devtools/shared/ThreadSafeDevToolsUtils.js:103

[Agbe]

1. Goes through all your posts looking for imgur.com direct links (.png|.jpg|.jpeg);
2. Reuploads the image to talkimg.com;
3. Edits the post with the new link.

I don't know if I misunderstood the script here. My question here is that, you are saying we should re-uploads the uploaded images from the imgur links and to talkimg. com but what about the images that are not the device, can they be found? Because the issue now is the images that are not in the hard drive.

How to use it:

1. Go to bitcointalk.org (any page).
2. Open the browser developer tools on the Console tab (Ctrl+Shift+I or F12).
3. Paste the script and press Enter.
4. Leave the page open while the script runs and, if you can, do not use the forum (not even in other tabs) to avoid rate limiting errors

And the above can only work in computer and not in Android.