Bitcoin Forum

Bitcoin => Bitcoin Discussion => Topic started by: da2ce7 on May 04, 2016, 07:27:32 PM



Title: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: da2ce7 on May 04, 2016, 07:27:32 PM
I was trying to archive some posts on the other "Bitcoin Forum" and quickly found out that is explicitly an disallowed action.

https://bitco.in/robots.txt

Code:
User-agent: ia_archiver
Disallow: /

User-agent: *
Disallow: /designertest/
Disallow: /forum/attachments/
Disallow: /forum/forums/*/?direction
Disallow: /forum/forums/*/?order
Disallow: /forum/help/
Disallow: /forum/login/
Disallow: /forum/lost-password/
Disallow: /forum/members/
Disallow: /forum/misc/
Disallow: /forum/online/
Disallow: /forum/posts/
Disallow: /forum/register/
Disallow: /forum/search/

What is more interesting is that the owners of the "bitco.in forum" have taken the time to explicitly block the archival site: https://archive.is/

For a site that claims:

Quote
Welcome to Bitcoin Forum.
No censorship. No BS.


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: unamis76 on May 04, 2016, 07:37:25 PM
I think the solution here is simply not using knock-off sites...


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: da2ce7 on May 04, 2016, 07:43:03 PM
I think the solution here is simply not using knock-off sites...

Agreed, however there is lots of content on that site that should be kept for future evidence. - It would be great if somebody did a dump of the entire forum.


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: unamis76 on May 04, 2016, 07:51:11 PM
I think the solution here is simply not using knock-off sites...

Agreed, however there is lots of content on that site that should be kept for future evidence. - It would be great if somebody did a dump of the entire forum.

Just got on the link and saw that's the alternative forum created a while ago... I thought it was one of those websites mirroring this forum. That being said my last post doesn't make that much sense and I wonder why they're blocking archival of their pages... It would be a nice question to ask, if someone has an account there. I think the only resort is maybe using another archival site, Internet Wayback Machine or storing the pages locally.


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: da2ce7 on May 04, 2016, 08:04:20 PM
For example:

archival of:

https://bitco.in/forum/threads/gold-collapsing-bitcoin-up.16/

would be quite nice, it is full of all sorts of juicy posts.


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: SebastianJu on May 04, 2016, 08:25:15 PM
I think the solution here is simply not using knock-off sites...

Agreed, however there is lots of content on that site that should be kept for future evidence. - It would be great if somebody did a dump of the entire forum.

Well that is the problem. The content. It's a well known technique of blackhat internet marketers to steal the content of a website or copy whole websites. Just to get visitors and earn from them.


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: pedrog on May 05, 2016, 04:05:04 PM
For example:

archival of:

https://bitco.in/forum/threads/gold-collapsing-bitcoin-up.16/

would be quite nice, it is full of all sorts of juicy posts.

https://archive.is/5XCLT


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: da2ce7 on May 05, 2016, 04:42:32 PM
For example:

archival of:

https://bitco.in/forum/threads/gold-collapsing-bitcoin-up.16/

would be quite nice, it is full of all sorts of juicy posts.

https://archive.is/5XCLT

The last archive is from 13 Sep 2015 02:57:12 UTC

If you try archiving now you get:

https://s32.postimg.org/7w281ssjn/error.png

https://archive.is/JdGDe


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: pedrog on May 05, 2016, 04:45:26 PM
For example:

archival of:

https://bitco.in/forum/threads/gold-collapsing-bitcoin-up.16/

would be quite nice, it is full of all sorts of juicy posts.

https://archive.is/5XCLT

The last archive is from 13 Sep 2015 02:57:12 UTC

If you try archiving now you get:

https://s32.postimg.org/7w281ssjn/error.png

https://archive.is/JdGDe

Well, then you should create a topic in that forum exposing the problem, there's nothing we can do here...


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: beastmodeBiscuitGravy on May 05, 2016, 05:22:39 PM
I think the solution here is simply not using knock-off sites...

Agreed, however there is lots of content on that site that should be kept for future evidence. - It would be great if somebody did a dump of the entire forum.

I don't get it. Blockstream won.

They now control the "reference" repo, this forum, r/bitcoin... blocks are full, fees are rising, miners do exactly as told, users are gleefully waiting to be steered into LN Hubs, altcoins, and other off-chain solutions.

Can't you just leave those guys to commiserate in peace?


Title: Re: Archival of "bitco.in" (including forums) blocked - WTF!?
Post by: 2c0de on May 05, 2016, 06:46:21 PM
It's the wall street / bitcoin Classic central
They sure as hell would not make it simple for you to dump their precious and smart comments