Bitcoin Forum

Other => Meta => Topic started by: metacoin on July 15, 2013, 03:11:47 PM



Title: Screen Scrape Rules
Post by: metacoin on July 15, 2013, 03:11:47 PM
If a bot were to scrape a thread for posts with a certain message in them, would this be against the rules of the forum?

Specifically the page would be downloaded once every 2-3 minutes at most, or whatever is acceptable.

Simply wondering what the rules are regarding this.


Title: Re: Screen Scrape Rules
Post by: Vod on July 15, 2013, 03:15:46 PM
If a bot were to scrape a thread for posts with a certain message in them, would this be against the rules of the forum?

Specifically the page would be downloaded once every 2-3 minutes at most, or whatever is acceptable.

Simply wondering what the rules are regarding this.

I asked about this recently, and it is allowed, as long as you don't hammer the server with requests.  Once every 2-3 minutes is fine.


Title: Re: Screen Scrape Rules
Post by: metacoin on July 15, 2013, 03:17:29 PM
If a bot were to scrape a thread for posts with a certain message in them, would this be against the rules of the forum?

Specifically the page would be downloaded once every 2-3 minutes at most, or whatever is acceptable.

Simply wondering what the rules are regarding this.

I asked about this recently, and it is allowed, as long as you don't hammer the server with requests.  Once every 2-3 minutes is fine.
Thanks for the information. I tried searching this forum for "screen scrape" and didn't get many results, even though there's a recent thread about it on the first page. Could you possibly provide a link to your discussion?


Title: Re: Screen Scrape Rules
Post by: 🏰 TradeFortress 🏰 on July 15, 2013, 03:18:45 PM
Probably in PM. As someone who reads pretty much every meta post, haven't heard of a mention of that.

Slightly offtopic but I don't think it's worth it's own thread, how do I get a message given an ID?


Title: Re: Screen Scrape Rules
Post by: whiskers75 on July 15, 2013, 04:23:29 PM
Probably in PM. As someone who reads pretty much every meta post, haven't heard of a mention of that.

Slightly offtopic but I don't think it's worth it's own thread, how do I get a message given an ID?
You need the topic ID as well:
https://bitcointalk.org/index.php?topic=[topic id].msg[message id]#msg[message id]