LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
April 08, 2020, 12:12:49 PM Last edit: April 23, 2020, 12:24:24 PM by LoyceV Merited by TheBeardedBaby (1) |
|
Another thing I've been thinking about is if someone posts something that's not allowed by my webhost. If that would happen, I'll have to edit it too. Well, that's a first: I censored data The credit card info sale is not good. pointed me at this post: http://loyce.club/archive/posts/5417/54178004.htmlI didn't check if my webhost allows it, but censored it anyway. Update (April 23, 2020): I received a PM (I'll keep the sender private, so sorry, no credits) about http://loyce.club/archive/posts/5428/54281329.html, which is now censored too.
|
|
|
|
NotATether
Legendary
Offline
Activity: 1652
Merit: 6937
In memory of o_e_l_e_o
|
|
April 11, 2020, 03:31:37 PM |
|
May I ask why you don't archive post titles? They would be useful while detecting deleted topics made by suspected scammers, I've seen some which only put their price tag in the title and not in their post body.
|
. .BLACKJACK ♠ FUN. | | | ███▄██████ ██████████████▀ ████████████ █████████████████ ████████████████▄▄ ░█████████████▀░▀▀ ██████████████████ ░██████████████ █████████████████▄ ░██████████████▀ ████████████ ███████████████░██ ██████████ | | CRYPTO CASINO & SPORTS BETTING | | │ | | │ | ▄▄███████▄▄ ▄███████████████▄ ███████████████████ █████████████████████ ███████████████████████ █████████████████████████ █████████████████████████ █████████████████████████ ███████████████████████ █████████████████████ ███████████████████ ▀███████████████▀ ███████████████████ | | .
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
April 11, 2020, 05:12:43 PM |
|
May I ask why you don't archive post titles? It started out as lazyness, and I kept it that way for compatibility. They would be useful while detecting deleted topics made by suspected scammers, I've seen some which only put their price tag in the title and not in their post body. I still have topic titles, see http://loyce.club/archive/topics/516/5167469.html for example. You just don't find it with each post.
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
April 22, 2020, 03:56:22 PM Last edit: April 22, 2020, 05:44:35 PM by LoyceV Merited by JayJuanGee (1) |
|
I'm thinking about an upgrade for searching topic histories: it's currently quite difficult to see which posts are deleted. I want to make a new thread (but need some time to do so) to request a topic analysis, after which the result will be a list of all posts in that topic. In this, I'll highlight: - All posts that I didn't scrape
- All posts that have been edited (within or after 10 minutes)
- All posts that have been deleted
- All posts that received Merit
I think this can be useful, but I need some time
|
|
|
|
ZaraCB
Full Member
Offline
Activity: 333
Merit: 105
www.cd3d.app
|
|
April 22, 2020, 05:41:55 PM Merited by JayJuanGee (1) |
|
- All posts that have been deleted (within or after 10 minutes)
There are two types of deleted post. 1. Deleted by moderators 2. Deleted by users. Do you have any plan to differentiate this two types?
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
April 22, 2020, 06:00:20 PM |
|
There are two types of deleted post. 1. Deleted by moderators 2. Deleted by users.
Do you have any plan to differentiate this two types? There's a third: Deleted by the topic starter of a self-moderated topic. I could only get data on the first category by keeping track of modlog, but I'm not going to add this feature as it will lead to incomplete data.
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
April 23, 2020, 12:10:39 PM Last edit: April 26, 2020, 12:10:36 PM by LoyceV Merited by OmegaStarScream (2) |
|
I found a bug (which I'm posting here as a reminder to myself): Posts on the עברי (Hebrew) board don't show up. Example: this post is missing, while it exists. I'll see if I can add them later. I think it has something to do with the right-to-left writing, even selecting text on that board doesn't work as expected. Update: عربية (Arabic) has the same problem. The problem doesn't occur with my real-time post scraper. this post for instance is archived just fine.
|
|
|
|
OmegaStarScream
Staff
Legendary
Offline
Activity: 3528
Merit: 6183
|
|
April 27, 2020, 03:16:54 PM Last edit: April 27, 2020, 08:25:05 PM by OmegaStarScream |
|
I found a bug (which I'm posting here as a reminder to myself): Posts on the עברי (Hebrew) board don't show up. Example: this post is missing, while it exists. I'll see if I can add them later. I think it has something to do with the right-to-left writing, even selecting text on that board doesn't work as expected. Update: عربية (Arabic) has the same problem. I could be wrong but I think that's only valid for the posts that have both latin and arabic/hebrew alphabets.
A suggestion... Have you thought about making a browser extension? I think it would be nice if we could access the archived posts directly from the forum's posts instead of having to manually check every post.
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
I could be wrong but I think that's only valid for the posts that have both latin and arabic/hebrew alphabets. Maybe. I currently have a few months of scraping to go, after that I'll re-scrape those boards and replace all posts in my archive by the freshly scraped ones. I still have to figure out what exactly I have to change for this. A suggestion... Have you thought about making a browser extension? I think it would be nice if we could access the archived posts directly from the forum's posts instead of having to manually check every post. I'll take your suggestion to [BETA] BPIP Extension - user info add-on / extension for Firefox, Chrome, et al. I'm not making any browser extensions myself.
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
May 05, 2020, 09:04:27 AM Last edit: May 27, 2020, 10:24:41 AM by LoyceV |
|
|
|
|
|
ChuckBuck
|
|
May 17, 2020, 06:07:13 AM |
|
Hi LoyceV, It's me again There was an edited post that mentioned me in it. I have not read it to the fullest yet. So I am very curious. Can you help me to search it? If I'm not mistaken, it is in the subject whose ID is 5244041 and #msg54439447.
|
|
|
|
Rikafip
Legendary
Offline
Activity: 1806
Merit: 6182
Iznad svih Hrvatska!
|
|
May 17, 2020, 06:37:22 AM |
|
Hi LoyceV, It's me again There was an edited post that mentioned me in it. I have not read it to the fullest yet. So I am very curious. Can you help me to search it? If I'm not mistaken, it is in the subject whose ID is 5244041 and #msg54439447. Hey Chuck, are you sure that's the correct topic ID? If I am not mistaken, that should be Wolfbet signature topic and from what I can see, that post hasn't been edited. http://loyce.club/archive/posts/5443/54439447.html
|
|
|
|
ChuckBuck
|
|
May 17, 2020, 06:45:02 AM |
|
The ID of topic is exactly. That means the article I need to read has been deleted I haven't read that post, but I know it mentioned me because I received a notification from the bot. Some first characters were quoted by the bot and I found that it mentioned me. I also know that it is made by Zwei. Can you help me find the deleted post?
|
|
|
|
Rikafip
Legendary
Offline
Activity: 1806
Merit: 6182
Iznad svih Hrvatska!
|
|
May 17, 2020, 06:47:24 AM |
|
The ID of topic is exactly. That means the article I need to read has been deleted I haven't read that post, but I know it mentioned me because I received a notification from the bot. Some first characters were quoted by the bot and I found that it mentioned me. I also know that it is made by Zwei. Can you help me find the deleted post? Post is in the link I just gave you, and there were no edits of that post, that I can see. Maybe you meant some other post and wrote wrong message ID?
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
May 17, 2020, 06:50:01 AM |
|
|
|
|
|
ChuckBuck
|
|
May 17, 2020, 12:53:25 PM |
|
Post is in the link I just gave you, and there were no edits of that post, that I can see. Maybe you meant some other post and wrote wrong message ID?
I also thought I was wrong somewhere I have found it following your instructions. From the list you gave above, I tried reading each post behind my post. But there are no post that contain content that I need The bot announced, it always works right whenever someone quotes my post or mentions me. But now I can not find. Maybe it's from my side Anyway, just a curiosity, I think I should ignore it Thank you very much!
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
May 23, 2020, 09:31:36 AM Merited by JayJuanGee (1) |
|
Update: you can now use TryNinja's site to search most posts created since June 2019: - Since I'm already scraping and saving posts, I'm also providing a website that lets you easily search for posts with filters (author, text, in X topic and date range) and share the scraped post so you can send to someone ( this original post, for example) or even archive it. I cleaned the database to make some changes and release the bot, so posts just go as far as May 14th. But I have enough hosting and space for at least 1 year of posts (and then I can renew), so you may be able to use it better in the future. Edit: now with +2,5 million old posts from loyce.club You can use it here: https://posts.ninjastic.space
|
|
|
|
ChuckBuck
|
|
June 03, 2020, 09:47:52 AM Last edit: June 03, 2020, 10:00:55 AM by ChuckBuck |
|
I have a small question here, hope you can answer it I have a habit of publishing my post early, then making necessary edits, such as updating information and data. This process can be 1 time or 2 times, it can be 3 times or more So, are they all stored? Or just the original post is archived? I think it would be interesting if all the edits were saved Have you thought about it yet?
|
|
|
|
LoyceV (OP)
Legendary
Offline
Activity: 3360
Merit: 16957
Thick-Skinned Gang Leader and Golden Feather 2021
|
|
June 03, 2020, 09:55:03 AM Last edit: June 05, 2020, 07:23:23 PM by LoyceV |
|
I have a small question here, hope you can answer it I have a habit of publishing my post early, then making necessary edits, such as updating information and data. This process can be 1 time or 2 times, it can be 3 times or more. So, are they all stored? Or just the original post is archived? I only archive the original unedited post. I think it would be interesting if all the edits were saved Have you thought about it yet? There's no way for me to know which posts have been edited. I'd have to check all 50 million posts again.
|
|
|
|
ChuckBuck
|
|
June 03, 2020, 10:06:25 AM |
|
I only archive the original unedited post.
Ahaa got it, it means you start browsing through all the new posts posted on this forum, then archive it. There's no way for me to know which posts have been edited. I'd have to check all 50 million posts again.
An impossible idea if I want to browse 50 million posts. There is no way to browse through them within seconds I had a wrong thought here. Yesterday, I was on another forum, when I edited the post, the post ID was changed. But I just checked, it doesn't happen on this forum We can skip my idea now
|
|
|
|
|