---

---

Ever wanted to see who's lying when a post has been edited or deleted? I may be able to help!

I archive most posts within seconds after they are created (before any edits). I started this data collection around the time I started this topic. All data I have since then is available online.
I also have older posts: I've saved (most) unedited posts (6.2 million posts) since September 12, 2018, until the start of this topic. This data has not been added to this topic, and I can't really add it because I tried to remove quotes and that has some bugs. You can request to dig up unedited data when needed.

Viewing unedited/deleted posts

• See https://loyce.club/archive/posts/ for all posts (Working!)
  New posts are archived within seconds after being created, and instantly available.
• See https://loyce.club/archive/members/ for posts made by a certain user (Working!)
  Updated every 5 minutes.
• See https://loyce.club/archive/topics/ for posts made in a certain topic (Working!)
  Updated every 5 minutes.

How to use it
Just click one of the links, and enter the msgID, userID or topicID.
Or (this older method still works):

• Find the msgID, userID or topicID you need. Let's use msgID 51902990.
• Remove the last 4 digits from the msgID to get the directory name (if there are 4 or less digits, use 0): 5190.
• Put everything together behind the (above) URL and add ".html": https://loyce.club/archive/posts/5190/51902990.html.

Details

• Files are stored with their msgID, userID or topicID as file name. I remove the last 4 digits to create the directory name. Each directory contains up to 10,000 HTML-files. Use CTRL-F to find what you're looking for.
• I don't scrape hidden boards (such as Investigations).
• I don't keep post titles
• I save raw HTML, including quotes
• If I run out of disk space, I might create compressed archives per 10,000 posts.
• Although I plan to preserve all data, I make no guarantees. Feel free to archive posts.
• My current (sponsored) webhost has enough storage space for years to come.
• All scrape-times use Amsterdam time (CET).
• Usually, I capture at least 99.95% of all posts. Server or internet connection problems can severely reduce this.

Examples

• The unedited version of this post: https://loyce.club/archive/posts/5190/51902990.html
  (the layout looks better in more recent archived posts)
• All posts made by me: https://loyce.club/archive/members/45/459836.html
  (obviously only since I started archiving posts)
• All posts made in this topic: https://loyce.club/archive/topics/516/5167469.html
  (the first posts aren't shown because of the slightly different format used for my archive)

---

---

Older posts

If anything goes wrong, let me know here.

---

---

See [overview] LoyceV's useful data on Bitcointalk for more of my forum-related topics

Thanks!
The "div class post" part is there already, I never removed it. I'll make some more adjustments, I was lazy using some headers from the forum HTML, but I'll recreate them on my own.

I've named it suchmoon.css


Update: see http://loyce.club/archive/posts/5190/51903915.html

I didn't know CSS is that easy

It works See http://loyce.club/archive/posts/5190/51904241.html

[quote author=LoyceV link=topic=5167469.msg51915669#msg51915669 date=1563822856]
Bump!

[quote author=LoyceV link=topic=4720640.msg51908047#msg51908047 date=1563775702]
This morning, I checked http://loyce.club/archive/posts/members/?SD and it instantly revealed a spammer: http://loyce.club/archive/posts/members/1514722.html
It got me thinking: I can create a daily list of users (sorted by the number of posts they made in the past 24 hours). That would instantly highlight users who post a lot, and makes it easy to identify bump spammers. If anyone's interested to check it once in a while, I'll make it [/quote]
[/quote]

I thought I'd see how significant the posts step down at the 8k/4k file size:



the middle one had just one post while the first and third have 29 and eight respectively.  I guess the posting list will ebb and surge during holidays and work days/week-ends.  Perhaps a known spammers' link be changed to another colour? (red/purple/orange etc for spammer/scammer nuked Flag etc)??

Where might we post our findings?

Instead of the 8k/4k approx file size an actual post count?

Also, (am making work for you now) a sort by file name / last posted etc?


Perhaps self moderated and a simple code


people can see when the posts were last reviewed so they aren't doubling up on work?

The member directory got messed up, I can't access my VPS from here so just don't look at it for the coming week.....

Correct.

Update.

Posts can be edited for 10 minutes without showing (or even keeping!) an edit history. But I'm not aiming to match the forum, I'm aiming to show the unedited post. And I can only download posts from recent when they're new, searching for posts that are 10 minutes old will be more work.

Ooops. I did not know that page. Checked it, and saw only ten pages available. Is it a fixed one (for all)? Or it is just a default page, and I can modify total displayed pages if I want?

Well said. Quotable LoyceV.

Of course you are inadvertently insinuating that women never lie. 

I'm thinking eventually it will be handy in trying to compare writing styles between users, in addition to the usual "but you originally said this" type situations.

I know you could probably parse all the text from particular users from the forum itself, but in the format on your server its easier for me to attempt such a thing.

I encourage you to keep it up as long as you can.