Archiving threads on Bitcointalk

[LordShanken]

Hello everyone,

I know website https://archive.fo/ which allows to archive the url address (1 website - 1 page of thread on Bitcointalk). I use it to avoid confusion if someone edits his post on Bitcointalk.

Things get complicated when it comes to an entire thread, which has, for example, 10 or 20 pages, because in archive.fo you have to archive each page of a thread on Bitcointalk separately (unless I don't know some option).
My question is, does anyone know any way or service that allows to archive the entire thread at once (so as not to play each page separately)?

[dkbit98]

My question is, does anyone know any way or service that allows to archive the entire thread at once (so as not to play each page separately)?

There is already something like that and it is called ninjastic.space made by forum member TryNinja , that is archiving everything in forum all the time.
There is also loyce.club made by LoyceV that is doing something similar, and you can easily access both of those service with community made (suchmoon and ibminer) BPIP browser extension.
With BPIP extension you are getting few more bonus surprises and forum improvements that is making life in bitcointalk much easier.

If you want to check all the ways you can archive bitcointalk posts yourself than you can check this Guide for Best ways to Archive Bitcointalk and other webpages.

[OmegaStarScream]

Add ;all to the URL. That should show the whole thread on one single page. I believe it only works with threads that have less than 20 pages. I could be wrong though.

[LordShanken]

My question is, does anyone know any way or service that allows to archive the entire thread at once (so as not to play each page separately)?

There is already something like that and it is called ninjastic.space made by forum member TryNinja , that is archiving everything in forum all the time.
There is also loyce.club made by LoyceV that is doing something similar, and you can easily access both of those service with community made (suchmoon and ibminer) BPIP browser extension.
With BPIP extension you are getting few more bonus surprises and forum improvements that is making life in bitcointalk much easier.

If you want to check all the ways you can archive bitcointalk posts yourself than you can check this Guide for Best ways to Archive Bitcointalk and other webpages.

Add ;all to the URL. That should show the whole thread on one single page. I believe it only works with threads that have less than 20 pages. I could be wrong though.

Thanks for the answers and hints! I will test it all now and come back soon with feedback which is most convenient. Maybe someday it will be useful to someone.

[Bitcoin_Arena]

Loyce.club actually does it better but for newer threads even if it has 50 pages +

Using the search tool, just type in the Topic ID of the thread and click on "Go to topic"
You will be able to see all archived links of the OP and replies to the post

For example in this post

Once you search it's topic ID

Code:

5233355

You will see all the scrapped/archived replies - https://loyce.club/archive/topics/523/5233355.html

[LoyceV]

My question is, does anyone know any way or service that allows to archive the entire thread at once (so as not to play each page separately)?

I think you're looking for "Show All" on long topics.
Example: https://loyce.club/showall/5335085.html (it works up to 500 pages). Note that a new request will overwrite this, so you can archive the resulting (long) page by yourself.

Or, if you want more details of each post, maybe you're looking for LoyceV's Topic Details: highlight deleted and edited posts (forum wide).
Example: https://loyce.club/archive/details/topic_5335085.html (it works up to 250 pages). New requests do not overwrite older archives.

[dkbit98]

I don't know if anyone heard but archive.org aka Wayback Machine was just hacked, and it was showing catastrophic security breach error.
Operators claimed website was under DDOS attacks for a while, and there are some people who don't like how archive.org was censorship resistant.
All posts archvied from Bitcointalk are currently unavailable, and someone is clearly trying to shut down this legendary website:
https://www.theverge.com/2024/10/9/24266419/internet-archive-ddos-attack-pop-up-message

Current state:



Update:
Have I Been Pwned website confirmed 31 millions users "breached" in Internet Archive hack including email address, screen names, passwords, and other data. https://www.bleepingcomputer.com/news/security/internet-archive-hacked-data-breach-impacts-31-million-users/

[logfiles]

<....>

I had no idea. I still wonder why such a site has no mirror links or back up versions, just in case

The other archiving sites such as archive.today don't seem reliable and popular as compared to the Wayback Machine site. Luckily, ninjastic.space and Loyce.club are here to our rescue when it comes to posts in the forum.

[NotATether]

<....>

I had no idea. I still wonder why such a site has no mirror links or back up versions, just in case

The other archiving sites such as archive.today don't seem reliable and popular as compared to the Wayback Machine site. Luckily, ninjastic.space and Loyce.club are here to our rescue when it comes to posts in the forum.

My scraper is still running strong, but yes, we will need a long-term solution to host Bitcointalk posts that does not rely on IA.

[albon]

I don't know if anyone heard but archive.org aka Wayback Machine was just hacked, and it was showing catastrophic security breach error.
Operators claimed website was under DDOS attacks for a while, and there are some people who don't like how archive.org was censorship resistant.
All posts archvied from Bitcointalk are currently unavailable, and someone is clearly trying to shut down this legendary website:
https://www.theverge.com/2024/10/9/24266419/internet-archive-ddos-attack-pop-up-message

Sad news, as the Wayback Machine is truly a treasure.

These scoundrels clearly want to erase archived information to evade censorship, and they may use the leaked data to scam people. It's worth noting that they have just posted an update on their official account on X in this [tweet], stating that no data was corrupted and they are curently upgrading the internal systems of Internet Archive after stopping the service. They will restore the services as quickly as possible and with complete security... Therefore, I advise users of this platform to change the passwords for their email accounts used to create their accounts, enable 2FA, and avoid any messages they might receive during this time that could be extortion/scam attempts.

[LoyceV]

Have I Been Pwned website confirmed 31 millions users "breached" in Internet Archive hack including email address, screen names, passwords, and other data. https://www.bleepingcomputer.com/news/security/internet-archive-hacked-data-breach-impacts-31-million-users/

I didn't even know you can create an account, the archives are accessible without it.
According to your link, the leak included Bcrypt-hashed passwords. Any decent password would be safe, which is why you should use a password manager and not something you can remember.

[dkbit98]

The other archiving sites such as archive.today don't seem reliable and popular as compared to the Wayback Machine site. Luckily, ninjastic.space and Loyce.club are here to our rescue when it comes to posts in the forum.

I tested almost all alternative services and Wayback Machine was best option, and it was even used for archiving documents and video material.
Maybe that is the reason they are hacked and under attack for some time, now even temporary offline message is removed from website.

My scraper is still running strong, but yes, we will need a long-term solution to host Bitcointalk posts that does not rely on IA.

Let's hope Wayback Machine will come back stronger, but it's not looking good for them.
Thanks for doing your part for archiving bitcointalk

I didn't even know you can create an account, the archives are accessible without it.
According to your link, the leak included Bcrypt-hashed passwords. Any decent password would be safe, which is why you should use a password manager and not something you can remember.

I also didn't know and I never had account there, but having over 30 million users is a huge number.

[Pmalek]

The attack and take-down of Wayback Machine was surely orchestrated by someone who doesn't like there to be old records of their wrongdoings. I don't see this as a hacker or group of blackhats trying to make a name for themselves. Everyone who believes in, don't believe your eyes, trust me, I am telling you the truth is happy and a potetial culprit. And there are many of those wearing suits and ties who hate the internet and the truth you can find on it.

[LTU_btc]

I don't know if anyone heard but archive.org aka Wayback Machine was just hacked, and it was showing catastrophic security breach error.
Operators claimed website was under DDOS attacks for a while, and there are some people who don't like how archive.org was censorship resistant.
All posts archvied from Bitcointalk are currently unavailable, and someone is clearly trying to shut down this legendary website:
https://www.theverge.com/2024/10/9/24266419/internet-archive-ddos-attack-pop-up-message

Yeah, noticed it last week when I wanted to check some archived stuff. It's sad that such big websites with so much data is so vulnerable in terms of security.
On Bitcointalk we have Loyce.club or Ninjastic.space, but globally, there is no alternative for Wayback Machine. Yes, there is Archive.is, but it's not same thing.

[dkbit98]

The attack and take-down of Wayback Machine was surely orchestrated by someone who doesn't like there to be old records of their wrongdoings. I don't see this as a hacker or group of blackhats trying to make a name for themselves.

There is no way hackers would do this, unless they are working for government and big corporations.

Yeah, noticed it last week when I wanted to check some archived stuff. It's sad that such big websites with so much data is so vulnerable in terms of security.
On Bitcointalk we have Loyce.club or Ninjastic.space, but globally, there is no alternative for Wayback Machine. Yes, there is Archive.is, but it's not same thing.

Wayback Machine website is back online for now, but I am sure attacks on them will continue.
I didn't check if all pages are working again but it did provide a lot of results for bitcointalk forum.
All other alternatives like archive.is, Ninjastic.space and Loyce.club are also very important.

[NotATether]

Yeah, noticed it last week when I wanted to check some archived stuff. It's sad that such big websites with so much data is so vulnerable in terms of security.

I wouldn't call the Internet Archive vulnerable in terms of security - in fact it has a lot of robust security features in place to stop hacks (even before this assault began).

However, almost any website can fall prey to classic DDoS scripts and botnets. The IA is no exception. It is really only big tech companies who have loads and loads of reverse proxies and load balancing who can withstand such an attack.