|
Title: scraping bot for bitcointalk.org - good for signature campaign Post by: babo on August 07, 2016, 02:47:24 PM hi people,
i can offer a webscraping bot for bitcointalk.org forum. i can scrape threads list in forum/subforum i can scrape all messages sent "today" filtered per user ^_^ of course i accept escrow (customer pay it) example of scraping - my last messages - http://pastebin.com/J4z4QUY4 Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: babo on August 08, 2016, 07:57:21 AM up
Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: Ryan Dugan on August 08, 2016, 05:50:39 PM Is this allowed ? I see many use scraping for a bad reason and you can't do it many places or they ban you. But you not doing it for bad ? I just see it for websites on competition to collect the info for offline to analyze .
Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: jeffersonairplane on August 08, 2016, 06:21:30 PM Is this allowed ? I see many use scraping for a bad reason and you can't do it many places or they ban you. But you not doing it for bad ? I just see it for websites on competition to collect the info for offline to analyze . I think it's a tool for signature campaign manager to use. I dont see any bad in it. Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: babo on August 08, 2016, 07:26:03 PM yes the main scope is use for managing signature campaign
Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: Supercrypt on August 08, 2016, 09:00:48 PM hi people, It does take a lot of time away from signature campaign managers hands and a very helpful method but there are free ones out there , if you want to sell it there are two ways you can do it , first is making a better version and giving free 1 or 2 copies to a bigger ranking person and they will check and vouch for it , or you can just sell it for free and add some sort of ad on there to make some bucks out of it.i can offer a webscraping bot for bitcointalk.org forum. i can scrape threads list in forum/subforum i can scrape all messages sent "today" filtered per user ^_^ of course i accept escrow (customer pay it) example of scraping - my last messages - http://pastebin.com/J4z4QUY4 Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: babo on August 09, 2016, 07:29:12 AM i dont know this free tool, can you link me? your idea isnt bad, i try to think a method for implement it
Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: Decoded on August 09, 2016, 11:18:34 AM Do you have any price in mind? I wouldnt mind trying to take on a managing a sig campaign as long as it won't impede on my other tasks.
How long does the scraper take to run and complete a scrape on say, 30 users? Can you scrape multiple users at once? Is the code clean and readable? (So I can take a look and edit it. I may even be able to host it on my server for other campaign managers to use. Kudos if the code has comments :D) Any distribution licences? What language is it written in? Title: Re: scraping bot for bitcointalk.org - good for signature campaign Post by: babo on August 09, 2016, 02:51:26 PM 1) no i dont have price in mind
2) i want to create a set of API on mashape 3) you dont need inspect the code :D 4) no code ^_^ only API 5) if you are interested im working to API and open it on mashape -- and u can use all languages ^_^ |