Bitcoin Forum
May 07, 2024, 01:34:18 AM *
News: Latest Bitcoin Core release: 27.0 [Torrent]
 
   Home   Help Search Login Register More  
Pages: [1]
  Print  
Author Topic: 2+ BTC Want to hire developer - Scraping assignment - http://www.coretennis.net/  (Read 1302 times)
statdude (OP)
Legendary
*
Offline Offline

Activity: 1498
Merit: 1000


View Profile
September 28, 2013, 08:07:53 PM
 #1

I do a lot of data scraping but am stumped.

LF a developer to create a tool to scrape all players "statistics" pages from from http://www.coretennis.net/majic/pageServer/0n0100000a/en/Search-Players.html.

Will pay at least 2 btc for this, negotiable.

Otherwise, am basically interested in players W/L records and other stats including points won, points won on serve/return, etc. for Futures/ITF (I have a source for this for ATP/WTA/Challenger)

▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ █████     █ ▀██████████ █
█ █████     █   ▀████████ █
█ █████  ██ █     ▀██████ █

█ █████  ▀▀ █▄▄▄▄▄▄▄█████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████             █████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
  Website
    Twitter
      Gitlab
      Reddit
    Telegram
Whitepaper
  ▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ ███████████████████████ █
█ ███▄    ███████▀   ▄███ █
█ ████▌    █████▀    ████ █
█ ████▌     ███▀     ████ █
█ ████▌▐█    █▀ █    ████ █
█ ████▌▐██     ██    ████ █
█ ████▌▐███   ███    ████ █
█ ███▀  ▀███ ███▀    ▀███ █
█ ███████████████████████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
1715045658
Hero Member
*
Offline Offline

Posts: 1715045658

View Profile Personal Message (Offline)

Ignore
1715045658
Reply with quote  #2

1715045658
Report to moderator
1715045658
Hero Member
*
Offline Offline

Posts: 1715045658

View Profile Personal Message (Offline)

Ignore
1715045658
Reply with quote  #2

1715045658
Report to moderator
"There should not be any signed int. If you've found a signed int somewhere, please tell me (within the next 25 years please) and I'll change it to unsigned int." -- Satoshi
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction.
1715045658
Hero Member
*
Offline Offline

Posts: 1715045658

View Profile Personal Message (Offline)

Ignore
1715045658
Reply with quote  #2

1715045658
Report to moderator
1715045658
Hero Member
*
Offline Offline

Posts: 1715045658

View Profile Personal Message (Offline)

Ignore
1715045658
Reply with quote  #2

1715045658
Report to moderator
1715045658
Hero Member
*
Offline Offline

Posts: 1715045658

View Profile Personal Message (Offline)

Ignore
1715045658
Reply with quote  #2

1715045658
Report to moderator
ndsdb
Newbie
*
Offline Offline

Activity: 49
Merit: 0


View Profile
September 28, 2013, 09:42:35 PM
 #2

Hi,

I am here to help now. PM me more details.
Eveofwar
Sr. Member
****
Offline Offline

Activity: 406
Merit: 250


View Profile
September 29, 2013, 12:48:05 AM
 #3

I've sent you a PM regarding this project.

Thanks
Ditto
Sr. Member
****
Offline Offline

Activity: 330
Merit: 250


View Profile
September 29, 2013, 01:50:48 AM
Last edit: September 29, 2013, 03:24:22 AM by Ditto
 #4

I have a fair amount of experience making web scraping programs (I recently did one for a member of this forum - Matthew). This should be pretty easy. How does the scraped data need to be output?

Edit: Made some good progress. So far, I have a script can go through the categories, then the pages for each category and get the links to each player's profile.
statdude (OP)
Legendary
*
Offline Offline

Activity: 1498
Merit: 1000


View Profile
September 29, 2013, 07:00:33 PM
 #5

New readers - please hold.

Will communicate through PM for completion - thanks for the replies! Anyone who got to this late - there will be more work. Thanks!

▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ █████     █ ▀██████████ █
█ █████     █   ▀████████ █
█ █████  ██ █     ▀██████ █

█ █████  ▀▀ █▄▄▄▄▄▄▄█████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████             █████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
  Website
    Twitter
      Gitlab
      Reddit
    Telegram
Whitepaper
  ▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ ███████████████████████ █
█ ███▄    ███████▀   ▄███ █
█ ████▌    █████▀    ████ █
█ ████▌     ███▀     ████ █
█ ████▌▐█    █▀ █    ████ █
█ ████▌▐██     ██    ████ █
█ ████▌▐███   ███    ████ █
█ ███▀  ▀███ ███▀    ▀███ █
█ ███████████████████████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
BitVegas
Sr. Member
****
Offline Offline

Activity: 252
Merit: 250



View Profile
September 30, 2013, 05:49:43 PM
 #6

I can do this quite easily. Also interested in future work.

btcbible
Full Member
***
Offline Offline

Activity: 143
Merit: 100

Coinality.com


View Profile WWW
October 01, 2013, 07:26:16 PM
 #7

In case you're still looking, may I suggest posting this job requirement on Coinality.com? In addition to submitting the job, you can also take a look at several relevant resumes of qualified candidates that may make a good match! Check it out! Coinality.com/resumes

Cheers,
DR | Coinality.com

Rycco
Full Member
***
Offline Offline

Activity: 147
Merit: 100



View Profile WWW
October 02, 2013, 03:43:36 AM
 #8

I can do this for 1.5 bitcoins. Please add me on skype:
R.nacif

AGILE WEB DEVELOPER  Senior Ruby on Rails Developer. Let's talk about your project! - SPANISH / PORTUGUESE / ENGLISH (TRANSLATOR)

Warncoin! Free SMS alert for Bitcoin's price I've developed.!

My Web Developer Topic.

internetguru
Member
**
Offline Offline

Activity: 86
Merit: 10


View Profile
October 02, 2013, 08:28:47 AM
 #9

I do a lot of data scraping but am stumped.

LF a developer to create a tool to scrape all players "statistics" pages from from http://www.coretennis.net/majic/pageServer/0n0100000a/en/Search-Players.html.

Will pay at least 2 btc for this, negotiable.

Otherwise, am basically interested in players W/L records and other stats including points won, points won on serve/return, etc. for Futures/ITF (I have a source for this for ATP/WTA/Challenger)

I can do this for 2 BTC - I can do it reliably and quickly - I can provide data first - and you can pay after

And if you like it I can give you a discount on future related work

Let me know if you're interested

Oct 17, 2013 - 2.44 BTC
Raoul Duke
aka psy
Legendary
*
Offline Offline

Activity: 1358
Merit: 1002



View Profile
October 02, 2013, 08:40:28 AM
 #10

Anyone working on this may wish to know that you can go straight to the players statistics page by increasing the ID in the URL, like:
http://www.coretennis.net/tennis-player/*/32655/stats.html
http://www.coretennis.net/tennis-player/*/32656/stats.html
http://www.coretennis.net/tennis-player/*/32657/stats.html
http://www.coretennis.net/tennis-player/*/32658/stats.html
etc.

You should ofcourse start at 1 and go from there Tongue
The player name part of the URL is not important, as it's only there for SEO purposes, hence why you may use an * instead of the name.
statdude (OP)
Legendary
*
Offline Offline

Activity: 1498
Merit: 1000


View Profile
October 08, 2013, 03:04:10 AM
Last edit: October 08, 2013, 05:05:35 AM by statdude
 #11

Guys -
I am still working with Gweedo on his version of the 1st project.

I have a new, 2nd project:

Requirements:
-Needs to be so easy to run, a 10 year old can do it with little to no setup, and export in a format importable into excel.
-Needs to be able to run at least 500 item #'s at once.
-Example: B006QP0R2E (http://camelcamelcamel.com/Pyle-Sports-PHRM38PN-Monitor-Calories/product/B006QP0R2E)

I need to be able to provide a list of Amazon ASIN #'s. From that, i need to scrape:

Amazon.com:
Amazon price from Amazon.com

CamelCamelCamel.com:
-Amazon, 3rd Party New, and 3rd Party used price from CamelCamelCamel.com,
-"last 5 price changes" shown for each

Ookong:
Highest, Lowest, Now for Amazon and 3rd party (or price history)

Please post or PM bids. examples of work can be sent to statdude@statdude.com. I'll discuss and select someone for project. Payment will be 1/3 in advance.
Thanks!

(Edit: I have been able to set this up working great in google docs using "importhtml", but only works for under 50 #'s)


▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ █████     █ ▀██████████ █
█ █████     █   ▀████████ █
█ █████  ██ █     ▀██████ █

█ █████  ▀▀ █▄▄▄▄▄▄▄█████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████  ▄▄▄▄▄▄▄▄▄  █████ █
█ █████             █████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
  Website
    Twitter
      Gitlab
      Reddit
    Telegram
Whitepaper
  ▄█▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀▀█▄
█ ███████████████████████ █
█ ███████████████████████ █
█ ███▄    ███████▀   ▄███ █
█ ████▌    █████▀    ████ █
█ ████▌     ███▀     ████ █
█ ████▌▐█    █▀ █    ████ █
█ ████▌▐██     ██    ████ █
█ ████▌▐███   ███    ████ █
█ ███▀  ▀███ ███▀    ▀███ █
█ ███████████████████████ █
█ ███████████████████████ █
▀█▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄▄█▀
Pages: [1]
  Print  
 
Jump to:  

Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!