Bitcoin Forum
May 08, 2024, 10:55:08 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Bitcoin Forum > Other > Meta > Can we block "print pages" in robots.txt?
Pages: [1]
« previous topic next topic »
  Print  
Author Topic: Can we block "print pages" in robots.txt?  (Read 1531 times)
ripper234 (OP)
Legendary
*
Offline Offline

Activity: 1358
Merit: 1003


Ron Gross


View Profile WWW
October 26, 2012, 08:19:05 AM
 #1
Often, the top Google result/s for a query is a print page - https://bitcointalk.org/index.php?action=printpage;topic=106596.0

I don't know why these pages appear so high on Google (relatively), but they're irrelevant, since the same content always appears in a better form if you remove the "action=printpage" from the URL.

Can we add to the site's robots.txt file a direction instructing robots not to index anything with the string "action=printpage" in its URL?
Please do not pm me, use ron@bitcoin.org.il instead
Mastercoin Executive Director
Co-founder of the Israeli Bitcoin Association
1715165708
Hero Member
*
Offline Offline

Posts: 1715165708

View Profile Personal Message (Offline)

Ignore
1715165708
1715165708
Reply with quote  #2
1715165708
Report to moderator
1715165708
Hero Member
*
Offline Offline

Posts: 1715165708

View Profile Personal Message (Offline)

Ignore
1715165708
1715165708
Reply with quote  #2
1715165708
Report to moderator
Be very wary of relying on JavaScript for security on crypto sites. The site can change the JavaScript at any time unless you take unusual precautions, and browsers are not generally known for their airtight security.
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1715165708
Hero Member
*
Offline Offline

Posts: 1715165708

View Profile Personal Message (Offline)

Ignore
1715165708
1715165708
Reply with quote  #2
1715165708
Report to moderator
1715165708
Hero Member
*
Offline Offline

Posts: 1715165708

View Profile Personal Message (Offline)

Ignore
1715165708
1715165708
Reply with quote  #2
1715165708
Report to moderator
1715165708
Hero Member
*
Offline Offline

Posts: 1715165708

View Profile Personal Message (Offline)

Ignore
1715165708
1715165708
Reply with quote  #2
1715165708
Report to moderator
Meni Rosenfeld
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1054



View Profile WWW
October 26, 2012, 08:23:28 AM
 #2
Wap2 versions also appear very often.
1EofoZNBhWQ3kxfKnvWkhtMns4AivZArhr   |   Who am I?   |   bitcoin-otc WoT
Bitcoil - Exchange bitcoins for ILS (thread)   |   Israel Bitcoin community homepage (thread)
Analysis of Bitcoin Pooled Mining Reward Systems (thread, summary)  |   PureMining - Infinite-term, deterministic mining bond
ripper234 (OP)
Legendary
*
Offline Offline

Activity: 1358
Merit: 1003


Ron Gross


View Profile WWW
October 26, 2012, 11:19:58 AM
 #3
Also, rel canonical might be useful.
Please do not pm me, use ron@bitcoin.org.il instead
Mastercoin Executive Director
Co-founder of the Israeli Bitcoin Association
deepceleron
Legendary
*
Offline Offline

Activity: 1512
Merit: 1032



View Profile WWW
November 16, 2012, 11:42:40 AM
 #4
theymos can make a robots.txt with these lines added:

User-agent: *
...(other stuff)
Disallow: /index.php?action=printpage
Disallow:  /index.php?wap2
J-Norm
Newbie
*
Offline Offline

Activity: 56
Merit: 0



View Profile
December 06, 2012, 05:08:50 PM
 #5
Quote from: gweedo on October 26, 2012, 09:21:19 AM
not really hard to remove them from the url and hit enter just saying

Humans working for computers...  Huh

Quote from: deepceleron on November 16, 2012, 11:42:40 AM
theymos can make a robots.txt with these lines added:

User-agent: *
...(other stuff)
Disallow: /index.php?action=printpage
Disallow:  /index.php?wap2


Computers working for humans...  Grin
Pages: [1]
  Print  
Bitcoin Forum > Other > Meta > Can we block "print pages" in robots.txt?
 « previous topic next topic »
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!