Bitcoin Forum
October 21, 2019, 04:03:49 AM *
News: 10th anniversary art contest
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: Can we block "print pages" in robots.txt?  (Read 1438 times)
ripper234
Legendary
*
Offline Offline

Activity: 1344
Merit: 1000


Ron Gross


View Profile WWW
October 26, 2012, 08:19:05 AM
 #1

Often, the top Google result/s for a query is a print page - https://bitcointalk.org/index.php?action=printpage;topic=106596.0

I don't know why these pages appear so high on Google (relatively), but they're irrelevant, since the same content always appears in a better form if you remove the "action=printpage" from the URL.

Can we add to the site's robots.txt file a direction instructing robots not to index anything with the string "action=printpage" in its URL?

Please do not pm me, use ron@bitcoin.org.il instead
Mastercoin Executive Director
Co-founder of the Israeli Bitcoin Association
1571630629
Hero Member
*
Offline Offline

Posts: 1571630629

View Profile Personal Message (Offline)

Ignore
1571630629
Reply with quote  #2

1571630629
Report to moderator
"There should not be any signed int. If you've found a signed int somewhere, please tell me (within the next 25 years please) and I'll change it to unsigned int." -- Satoshi
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1571630629
Hero Member
*
Offline Offline

Posts: 1571630629

View Profile Personal Message (Offline)

Ignore
1571630629
Reply with quote  #2

1571630629
Report to moderator
1571630629
Hero Member
*
Offline Offline

Posts: 1571630629

View Profile Personal Message (Offline)

Ignore
1571630629
Reply with quote  #2

1571630629
Report to moderator
Meni Rosenfeld
Donator
Legendary
*
Offline Offline

Activity: 2058
Merit: 1018



View Profile WWW
October 26, 2012, 08:23:28 AM
 #2

Wap2 versions also appear very often.

1EofoZNBhWQ3kxfKnvWkhtMns4AivZArhr   |   Who am I?   |   bitcoin-otc WoT
Bitcoil - Exchange bitcoins for ILS (thread)   |   Israel Bitcoin community homepage (thread)
Analysis of Bitcoin Pooled Mining Reward Systems (thread, summary)  |   PureMining - Infinite-term, deterministic mining bond
gweedo
Legendary
*
Offline Offline

Activity: 1274
Merit: 1000


View Profile
October 26, 2012, 09:21:19 AM
 #3

not really hard to remove them from the url and hit enter just saying
ripper234
Legendary
*
Offline Offline

Activity: 1344
Merit: 1000


Ron Gross


View Profile WWW
October 26, 2012, 11:19:58 AM
 #4

Also, rel canonical might be useful.

Please do not pm me, use ron@bitcoin.org.il instead
Mastercoin Executive Director
Co-founder of the Israeli Bitcoin Association
deepceleron
Legendary
*
Offline Offline

Activity: 1512
Merit: 1000



View Profile WWW
November 16, 2012, 11:42:40 AM
 #5

theymos can make a robots.txt with these lines added:

User-agent: *
...(other stuff)
Disallow: /index.php?action=printpage
Disallow:  /index.php?wap2
J-Norm
Newbie
*
Offline Offline

Activity: 56
Merit: 0



View Profile
December 06, 2012, 05:08:50 PM
 #6

not really hard to remove them from the url and hit enter just saying

Humans working for computers...  Huh

theymos can make a robots.txt with these lines added:

User-agent: *
...(other stuff)
Disallow: /index.php?action=printpage
Disallow:  /index.php?wap2


Computers working for humans...  Grin
Pages: [1]
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!