Bitcoin Forum

Economy => Services => Topic started by: statdude on September 28, 2013, 08:07:53 PM



Title: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: statdude on September 28, 2013, 08:07:53 PM
I do a lot of data scraping but am stumped.

LF a developer to create a tool to scrape all players "statistics" pages from from http://www.coretennis.net/majic/pageServer/0n0100000a/en/Search-Players.html.

Will pay at least 2 btc for this, negotiable.

Otherwise, am basically interested in players W/L records and other stats including points won, points won on serve/return, etc. for Futures/ITF (I have a source for this for ATP/WTA/Challenger)


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: ndsdb on September 28, 2013, 09:42:35 PM
Hi,

I am here to help now. PM me more details.


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: Eveofwar on September 29, 2013, 12:48:05 AM
I've sent you a PM regarding this project.

Thanks


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: Ditto on September 29, 2013, 01:50:48 AM
I have a fair amount of experience making web scraping programs (I recently did one for a member of this forum - Matthew (https://bitcointalk.org/index.php?action=profile;u=24749)). This should be pretty easy. How does the scraped data need to be output?

Edit: Made some good progress. So far, I have a script can go through the categories, then the pages for each category and get the links to each player's profile.


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: statdude on September 29, 2013, 07:00:33 PM
New readers - please hold.

Will communicate through PM for completion - thanks for the replies! Anyone who got to this late - there will be more work. Thanks!


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: BitVegas on September 30, 2013, 05:49:43 PM
I can do this quite easily. Also interested in future work.


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: btcbible on October 01, 2013, 07:26:16 PM
In case you're still looking, may I suggest posting this job requirement on Coinality.com (http://Coinality.com)? In addition to submitting the job, you can also take a look at several relevant resumes of qualified candidates that may make a good match! Check it out! Coinality.com/resumes (http://Coinality.com/resumes)

Cheers,
DR | Coinality.com (http://Coinality.com)


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: Rycco on October 02, 2013, 03:43:36 AM
I can do this for 1.5 bitcoins. Please add me on skype:
R.nacif


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: internetguru on October 02, 2013, 08:28:47 AM
I do a lot of data scraping but am stumped.

LF a developer to create a tool to scrape all players "statistics" pages from from http://www.coretennis.net/majic/pageServer/0n0100000a/en/Search-Players.html.

Will pay at least 2 btc for this, negotiable.

Otherwise, am basically interested in players W/L records and other stats including points won, points won on serve/return, etc. for Futures/ITF (I have a source for this for ATP/WTA/Challenger)

I can do this for 2 BTC - I can do it reliably and quickly - I can provide data first - and you can pay after

And if you like it I can give you a discount on future related work

Let me know if you're interested


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: Raoul Duke on October 02, 2013, 08:40:28 AM
Anyone working on this may wish to know that you can go straight to the players statistics page by increasing the ID in the URL, like:
http://www.coretennis.net/tennis-player/*/32655/stats.html
http://www.coretennis.net/tennis-player/*/32656/stats.html
http://www.coretennis.net/tennis-player/*/32657/stats.html
http://www.coretennis.net/tennis-player/*/32658/stats.html
etc.

You should ofcourse start at 1 and go from there :P
The player name part of the URL is not important, as it's only there for SEO purposes, hence why you may use an * instead of the name.


Title: Re: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/
Post by: statdude on October 08, 2013, 03:04:10 AM
Guys -
I am still working with Gweedo on his version of the 1st project.

I have a new, 2nd project:

Requirements:
-Needs to be so easy to run, a 10 year old can do it with little to no setup, and export in a format importable into excel.
-Needs to be able to run at least 500 item #'s at once.
-Example: B006QP0R2E (http://camelcamelcamel.com/Pyle-Sports-PHRM38PN-Monitor-Calories/product/B006QP0R2E)

I need to be able to provide a list of Amazon ASIN #'s. From that, i need to scrape:

Amazon.com:
Amazon price from Amazon.com

CamelCamelCamel.com:
-Amazon, 3rd Party New, and 3rd Party used price from CamelCamelCamel.com,
-"last 5 price changes" shown for each

Ookong:
Highest, Lowest, Now for Amazon and 3rd party (or price history)

Please post or PM bids. examples of work can be sent to statdude@statdude.com. I'll discuss and select someone for project. Payment will be 1/3 in advance.
Thanks!

(Edit: I have been able to set this up working great in google docs using "importhtml", but only works for under 50 #'s)