Web Crawler Jobs

62 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Hourly - Intermediate ($$) - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
Description of the Job Data Collection: Input information in the provided data sheet on each company. Data sheets will be provided in batches i.e. after completion of one spreadsheet, a new data set will be provided. Follow descriptions of each data field for the collection of data Category/industry specialty will be a preset data Skills Required: Web Research Cold Calling Data Entry Google sheets Note: Candidate will be given one data row in the beginning to test their capability.
Skills: Web Crawler Data Entry Microsoft Office
Hourly - Expert ($$$) - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
We're in need of a developer (or agency) with expertise in the scraping of data from a number of public websites. Developer will deploy and manage a system to scrape available data on tens of thousands of professionals (accountants, attorneys, doctors, etc.) from dozens of websites. That data then needs to be organized within a database (preferably MySQL). To end users, the data will ultimately appear as "listings" of professionals within a searchable directory. Each list will represent one individual professional, and be comprised of a dozen or so fields (including "name", "address", "category of expertise", among other fields.) THE FOLLOWING SKILLS ARE BENEFITS, BUT NOT REQUIREMENTS: Scraping large sites that employ anti-scrape tactics. Please have experience bypassing such technology. Scraping fast, using threading (or a better method...we're open to recommendations). Ability to support proxies (both to bypass anti-scraping systems and scrape faster). Scraping data based on xpath to save into database (either elasticsearch, mongodb, postgre, mysql). Experience developing user interfaces to a database a plus, but not a requirement. THE FOLLOWING SKILLS ARE REQUIREMENTS: Scraping system proposed SHOULD NOT be built from scratch. There are plenty of existing open source solutions available. Please DO NOT bid if you don't have experience. Thank you.
Skills: Web Crawler Database Administration User interface design Web scraping