You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

52 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Fixed-Price - Expert ($$$) - Est. Budget: $50 - Posted
We search for a data research expert who is able to extract for us the company details of the given sites. Your job is to deliver java code which extracts following details from the weblinks given here: A set URLs for different areas: http://www.immobilienscout24.de/anbieter/suchen/Baden-Wuerttemberg/Boeblingen-Kreis/Herrenberg?geocodeid=1276001006010&focustype=1,2,3,6,7&includeOperationAreas=true http://www.immobilienscout24.de/anbieter/suchen/Baden-Wuerttemberg/Ostalbkreis/Schwaebisch-Gmuend?geocodeid=1276001028034&focustype=1,2,3,6,7&includeOperationAreas=true A set URLs for different areas: http://www.meinestadt.de/herrenberg/berufe-branchen/handwerk http://www.meinestadt.de/herrenberg/berufe-branchen/pflegeberufe Your delivery has to be in following format: https://docs.google.com/spreadsheets/d/17Ug0grVXxb7dZGv7cQgGjd2tzZHeDCN7PTNDIMbVkuw/edit?usp=sharing Please ignore the test/checking tasks of the home pages. We need the full address, phone, email, internet address of the entries. Please ignore our placed budget and place your bid in USD along with the brief description which technology you prefer on solution. We have a lot of more work to do, as you may already see.
Skills: Web Crawler Data scraping Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $150 - Posted
I need one java script to crawl 5 sites (only a small portion of the site and not the whole site) and create a excel sheet (tab delimited) of the results. This sites have products and I need to run this script daily so I need it to be fast. Please let me know if you have any questions. This site are public site and no password is needed to access them.
Skills: Web Crawler JavaScript
Fixed-Price - Intermediate ($$) - Est. Budget: $5,000 - Posted
The job requires creativity and analytical thinking to solve problems and move the growth metrics for the project. Skills Required 1. Web Crawling 2. Scripting: Javascript/Ruby/Python 3. File I/O: Reading and writing to CSV files. Mentorship will be provided if needed. Fixed pay for the task however I am flexible and can pay hourly once we establish a rapport.
  • Number of freelancers needed: 10
Skills: Web Crawler Web scraping
Hourly - Expert ($$$) - Est. Time: More than 6 months, Less than 10 hrs/week - Posted
We need assistance building a sales prospecting tool for our internal sales team. At it's most basic, the tool will scrape web results and log data that meets certain parameters in a CSV file. As such we will need a web based platform that we can input our search criteria into, have the tool go out and scrape the data then dump the data into a csv file. The scraping will involve the use of proxies via an API. There are also other APIs that may assist with some of the functionality that we can present to suitable applicants as we discuss the project further. We only need this basic functionality for an MVP, so the initial project scope will be simple. In the long run we envisage potentially expanding on the feature set and launching it as a SaaS tool, which we will discuss further with applicants. If you are interested please get in touch and let us know how you would build the first part of it, and we'll start a discussion about the future extra functionality.
Skills: Web Crawler Web Crawling Data mining Data scraping
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App