60M posts! View unedited/deleted posts (search per post, per user or per topic)

[LoyceV]

From a technical perspective, there is nothing to prevent a government from collecting post information on bitcointalk. However if bitcointalk policies explicitly disallow government law enforcement from collecting information in mass via automation, in general, law enforcement will have trouble using information gained via these means as the basis for a warrant, or as admissible evidence in court.

This makes sense, you should send the suggestion to theymos (or create a topic in Meta).

[TECSHARE]

From a technical perspective, there is nothing to prevent a government from collecting post information on bitcointalk. However if bitcointalk policies explicitly disallow government law enforcement from collecting information in mass via automation, in general, law enforcement will have trouble using information gained via these means as the basis for a warrant, or as admissible evidence in court.

This makes sense, you should send the suggestion to theymos (or create a topic in Meta).

Unfortunately without an explicit terms of service, this kind of policy is legally meaningless, and Theymos has made it pretty clear in the past he doesn't want to use one.

[eddie13]

It was a joke.. It doesn't mean I don't still like you LV..
Maybe it serves as a reminder that you all are being monitored..

I may have been an outlaw all my life but i have always strived to be an honest outlaw..

[LoyceV]

Sneak preview: I'm working on a per-topic-view. See http://loyce.club/archive/topics/
And I'm working on a and per-user-view, see http://loyce.club/archive/members/

[JeromeTash]

Hey LoyceV, I would like to appreciate the work you have done to this community.
 I just wanted to know whether this tool archives even replies that have been made in a deleted topic or this applies only to directly deleted topics.

[LoyceV]

I just wanted to know whether this tool archives even replies that have been made in a deleted topic or this applies only to directly deleted topics.

I'm not sure what you're asking me... I archive all post (okay, maybe 99.9% of all posts) within a few seconds. If the topic gets deleted, I keep the archive.
I'm still working on improving the per-topic and per-user view.

[LoyceV]

My webhost is out of disk space
I've opened a ticket and keep local backups of all newly scraped posts so no data will be lost. Once they resolve this, my uploads should start catching up.

Update: this was fixed 2 days ago.

[Timelord2067]

Is this post too far back in time? https://bitcointalk.org/index.php?topic=3387794.msg35493516#msg35493516

[LoyceV]

Is this post too far back in time? https://bitcointalk.org/index.php?topic=3387794.msg35493516#msg35493516

Yes. The oldest post I have is 45589103. Back then, I didn't upload the files and now just keep them locally in case someone asks for them.

[Timelord2067]

Is this post too far back in time? https://bitcointalk.org/index.php?topic=3387794.msg35493516#msg35493516

Yes. The oldest post I have is 45589103. Back then, I didn't upload the files and now just keep them locally in case someone asks for them.

I would appreciate it if you PM me that post / thread?

Regards,

[LoyceV]

I would appreciate it if you PM me that post / thread?

I think you misunderstood what I was trying to say: I don't have any posts older than September 2018, and I've only been uploading scraped files since July this year (with some incomplete data mainly at the start).
So I don't have the thread you're looking for, and I can't find it on Archive.org either. Sorry

[Timelord2067]

I would appreciate it if you PM me that post / thread?

I think you misunderstood what I was trying to say: I don't have any posts older than September 2018, and I've only been uploading scraped files since July this year (with some incomplete data mainly at the start).
So I don't have the thread you're looking for, and I can't find it on Archive.org either. Sorry

Yeh, my bad. I haven't read many of the scraped posts, so am a little rusty.

Have wrapped up what I was working on and got it out there for peer review.

Regards,

[LoyceV]

I just noticed my webhost's DNS server is gone, and looking further I noticed I haven't uploaded any posts for the past 2.5 days.

Amazingly, my hosting itself works fine So, I've switched DNS servers to Namecheap, and I'm currently uploading 23,000 posts. That means the file timestamps will be incorrect, but the data inside the files is still good.

[KTChampions]

LoyceV

Did the service work correctly on November 28-29? I see there are edited posts, but they did not get into the archive.
The question is quite serious since a scammer with Hero rank can avoid punishment.

[LoyceV]

Did the service work correctly on November 28-29? I see there are edited posts, but they did not get into the archive.
The question is quite serious since a scammer with Hero rank can avoid punishment.

I have 9995, 9998 and 9995 posts (out of 10000) around these days. That means I missed only 0.04% of all posts, and some of them were probably in topics that aren't publicly accessible.

I'm currently running an update on members and topics, that should be enough to find back most posts.

Can you share links to the posts that you can't find in my archive?

[KTChampions]

Can you share links to the posts that you can't find in my archive?

https://bitcointalk.org/index.php?topic=5183095.msg53207068#msg53207068
and
https://bitcointalk.org/index.php?topic=5193171.msg53206785#msg53206785

Thank you 

[LoyceV]

https://bitcointalk.org/index.php?topic=5183095.msg53207068#msg53207068
and
https://bitcointalk.org/index.php?topic=5193171.msg53206785#msg53206785

I think you must have been looking at the wrong place. The first 4 characters of the msg number are 5320, that means go to http://loyce.club/archive/posts/5320/.
Then, find the posts in that list (use CTRL-F):
http://loyce.club/archive/posts/5320/53207068.html
and
http://loyce.club/archive/posts/5320/53206785.html

[KTChampions]

https://bitcointalk.org/index.php?topic=5183095.msg53207068#msg53207068
and
https://bitcointalk.org/index.php?topic=5193171.msg53206785#msg53206785

I think you must have been looking at the wrong place. The first 4 characters of the msg number are 5320, that means go to http://loyce.club/archive/posts/5320/.
Then, find the posts in that list (use CTRL-F):
http://loyce.club/archive/posts/5320/53207068.html
and
http://loyce.club/archive/posts/5320/53206785.html

Yes you are right. I tried to find these posts here: http://loyce.club/archive/members/18/189726.html
Thank you very much for the help 

[LoyceV]

Yes you are right. I tried to find these posts here: http://loyce.club/archive/members/18/189726.html

Those pages only get manual updates, and the current update is still running. So you were looking at the right place, I just don't have the time to fix it.

[LoyceV]

Today, I slightly moved my netbook, and just touching it was enough to make it crash. Unfortunately, I had to go at that moment, so I couldn't fix it right away.
That means, I haven't archived any posts for between posts 53250266 and 53251174. The gap is just under 1.5 hours.
Unfortunately, I can't catch up on those 907 posts