Bitcoin Forum
December 09, 2016, 11:27:17 PM *
News: Latest stable version of Bitcoin Core: 0.13.1  [Torrent].
 
   Home   Help Search Donate Login Register  
Pages: [1]
  Print  
Author Topic: Harvesting/Scraping  (Read 2190 times)
Bitsky
Hero Member
*****
Offline Offline

Activity: 542


View Profile
July 03, 2011, 02:34:57 PM
 #1

I have a bit of spare time, so if someone needs data scraped from a website, drop me a PM.

Data can be provided as CSV or SQL.

Price depends on the complexity and amount of data.

Bounty: Earn up to 68.7 BTC
Like my post? Feel free to drop a tip to 1BitskyZbfR4irjyXDaGAM2wYKQknwX36Y
Advertised sites are not endorsed by the Bitcoin Forum. They may be unsafe, untrustworthy, or illegal in your jurisdiction. Advertise here.
1481326037
Hero Member
*
Offline Offline

Posts: 1481326037

View Profile Personal Message (Offline)

Ignore
1481326037
Reply with quote  #2

1481326037
Report to moderator
1481326037
Hero Member
*
Offline Offline

Posts: 1481326037

View Profile Personal Message (Offline)

Ignore
1481326037
Reply with quote  #2

1481326037
Report to moderator
1481326037
Hero Member
*
Offline Offline

Posts: 1481326037

View Profile Personal Message (Offline)

Ignore
1481326037
Reply with quote  #2

1481326037
Report to moderator
ErgoOne
Full Member
***
Offline Offline

Activity: 126


View Profile
July 05, 2011, 11:11:27 PM
 #2

Not to be a spoilsport, but if the "data" that you are offering to scrape is email addresses, please be aware that Spamhaus, Spamcop, SURBL, URIBL, and most of the other widely-used anti-spam blocklists consider sending bulk email to scraped addresses to be spam.  Spamhaus lists the web sites that sell lists of email addresses in their main blocklist for spam support. 

If you can write code to scrape web sites, you can also write code to do other things that are more productive and less likely to piss people who don't like spam off at you.  Just an idea. :-)
PandaMiner
Sr. Member
****
Offline Offline

Activity: 252


I got scammed Jan2014


View Profile WWW
July 07, 2011, 05:39:09 PM
 #3

Scraping, like hacking, has a bad rap. 

It's just a tool.  Sure, most people, when they hear/think of "scraping" a website, think of "spam" and "scraping emails."

Scraping is a tool.  Too bad it has been used for spamming in the public eye. But scraping in and of itself, is not bad, or negative, or time wasting.

Big companies do it all the time, and they're not scraping email addresses. They are scraping other things, information. Big companies scrape eachother.

As a marketer, I've scraped a few of my merchant's sites (when they don't offer a datafeed).  I create my own datafeed.

Scraping is not evil.  It's what people do with what's scraped, that can be positive or negative.

But I digress.

My Litecoin address: Lf9WKM61AhmXchG2Ph2cftHKSQhxHutcdk
My Bitcoin address: 1Hwem4GSQWPCtBTKcSpXg2jYwxF6PtTjZx
--> Have you tried Triplemining.com? <--
ErgoOne
Full Member
***
Offline Offline

Activity: 126


View Profile
July 07, 2011, 11:30:37 PM
 #4

If you're doing scraping for some purpose other than spamming or stealing somebody else's data, I have no problem with it.  In my experience, however, the majority of cases where somebody scrapes web sites for hire involve email addresses to be used for spamming.  That doesn't mean that there aren't legitimate uses for scraping, just that I don't often see them in use.
PandaMiner
Sr. Member
****
Offline Offline

Activity: 252


I got scammed Jan2014


View Profile WWW
July 08, 2011, 12:00:27 AM
 #5

Yeah. It's sad that the negatives get more publicity. :-/

My Litecoin address: Lf9WKM61AhmXchG2Ph2cftHKSQhxHutcdk
My Bitcoin address: 1Hwem4GSQWPCtBTKcSpXg2jYwxF6PtTjZx
--> Have you tried Triplemining.com? <--
ArsenShnurkov
Legendary
*
Offline Offline

Activity: 1386



View Profile
August 04, 2011, 03:39:16 PM
 #6

You should market your services as "Data import", "Data cleaning", "Data processing" and provide a portfolio of some interesting results.

How well do you know http://kettle.pentaho.com/ ?
Can you integrate your parsers with it ?
doldgigger
Full Member
***
Offline Offline

Activity: 170


View Profile
August 04, 2011, 03:54:46 PM
 #7

If you're doing scraping for some purpose other than spamming or stealing somebody else's data, I have no problem with it.  In my experience, however, the majority of cases where somebody scrapes web sites for hire involve email addresses to be used for spamming.  That doesn't mean that there aren't legitimate uses for scraping, just that I don't often see them in use.
During the past few years, I sold a couple of data scraping solutions, none of which fitting into your less than legitimate categories. So, if you are seeing mostly illegitimate uses of scraping, maybe you want to look for another peer group of people to work with?

More importantly: rather than insulting people enriching the bitcoin economy by providing services, why not offer services yourself? Just an idea... :-)

19orEcoqXQ5bzKbzbAnbQrCkQC5ahSh4P9
Feel free to PM me for consulting and development services.
Pages: [1]
  Print  
 
Jump to:  

Sponsored by , a Bitcoin-accepting VPN.
Powered by MySQL Powered by PHP Powered by SMF 1.1.19 | SMF © 2006-2009, Simple Machines Valid XHTML 1.0! Valid CSS!