LoyceV's Topic Details: highlight deleted and edited posts (forum wide)

[Rizzrack]

https://loyce.club/archive/details/topic_2647654.html and bump 

[alani123]

https://loyce.club/archive/details/topic_5264620.html

Can this be used to see if a thread was moved to a different board?

[LoyceV]

~snip link to prevent it from archiving again~

My "later backups" ended here. That's because I haven't processed all data yet, but I should have it archived already. If you're looking for an older post that was deleted recently, you can try again later. I need some time to finalize this data.

Can this be used to see if a thread was moved to a different board?

No, I don't keep track of boards. The thread you requested was on the Reputation board when I first saw it.

[Jet Cash]

There are two types of edit. One is a change to the text because the poster made a typo, or posted the wrong info. The other edit is an addition to a post, and this is something I do. Your post may be the last in a thread, and you may want to add additional information without creating a series of posts by a single member. It would be interesting to be able to find these posts. Maybe we could tag them to make them easier to list. Tags such as [UPDATE] or [ADDITION] could be used.

Another advantage of this is that such threads would not be bumped, but an alert would allow interested readers to find them.

[Rizzrack]

My "later backups" ended here. That's because I haven't processed all data yet, but I should have it archived already. If you're looking for an older post that was deleted recently, you can try again later. I need some time to finalize this data.

Was actually looking for a recent post that was recently deleted (few days old)

[LoyceV]

There are two types of edit. One is a change to the text because the poster made a typo, or posted the wrong info. The other edit is an addition to a post, and this is something I do. Your post may be the last in a thread, and you may want to add additional information without creating a series of posts by a single member. It would be interesting to be able to find these posts. Maybe we could tag them to make them easier to list. Tags such as [UPDATE] or [ADDITION] could be used.

I won't even try to automate detecting the difference, but it happens a lot indeed. People adding a comma or fixing a typo. Those can easily be spotted by comparing the old and new backup, and those cases are not the reason I created this topic.

Another advantage of this is that such threads would not be bumped, but an alert would allow interested readers to find them.

If the last post in a topic gets edited after I've read it, it shows as on the board overview. But it doesn't show as on the Watchlist. That could be a good feature to add to the forum.

[alani123]

Can this be used to see if a thread was moved to a different board?

No, I don't keep track of boards. The thread you requested was on the Reputation board when I first saw it.

Hm, it might be useful to note the board.
Now I wonder about how the archive tool behaves on moved (and trash-canned) threads, redirection messages and the likes.

[LoyceV]

Hm, it might be useful to note the board.

It's too late for that, unless I re-scrape all topics everything, and I don't really want to do that.

Now I wonder about how the archive tool behaves on moved (and trash-canned) threads, redirection messages and the likes.

Moving to a different board doesn't change the topicID, and I search everything based on the topicID. If the topic gets deleted, my details still work on the original topicID.
I'm not sure if Mods can merge or split topics, but that would mess it up.

[LoyceV]

Update:

Since February 2020, I'm scraping and archiving all older posts too (this will take a couple more months to complete) Update: this was completed in August 2020.

I now have (almost) all posts archived. However, I still don't highlight deleted posts from my "older" archive. I'll add this after listing all posts per topic (and per member).

[namarang]

I think the update should include the content and generally everything included in the post.

[alani123]

I think it would be super useful if we could see which posts/replies of a user profile have been deleted by having it highlighted on the user page also...
It can be done for a post, so maybe in a similar fashion also for a profile. Perhaps on a per-request basis to reduce load by extra scraping/maching.

Thanks.

[LoyceV]

I think it would be super useful if we could see which posts/replies of a user profile have been deleted by having it highlighted on the user page also...

I agree, but:

My initial plan was to make this for a user's post history too, but it was much more work than anticipated, so I skipped that.

[Rikafip]

Bump for this excellent tool!

https://loyce.club/archive/details/topic_5265765.html

[LoyceV]

https://loyce.club/archive/details/topic_5282911.html

[DarkStar_]

https://loyce.club/archive/details/topic_3243635.html

[DarkStar_]

https://loyce.club/archive/details/topic_3243635.html

[DarkStar_]

https://loyce.club/archive/details/topic_3243635.html

[suchmoon]

https://loyce.club/archive/details/topic_3243635.html

Something seems to be broken... the thread is 59 pages but the scraper is at 220+ already.

[DarkStar_]

https://loyce.club/archive/details/topic_3243635.html

Something seems to be broken... the thread is 59 pages but the scraper is at 220+ already.

It seems to have finally stopped, with just the minor side effect of posts on the last thread showing 192 times. I wonder if some sort of rate limit was hit to stop it; I was kinda expecting it to run infinitely until Loyce stops it 

[suchmoon]

It seems to have finally stopped, with just the minor side effect of posts on the last thread showing 192 times. I wonder if some sort of rate limit was hit to stop it; I was kinda expecting it to run infinitely until Loyce stops it 

I think it hit the 250-page hard limit:

This service is currently limited to scraping the first 250 pages of a topic.