You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Scraping Jobs

147 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Looking for the Team App?
Download the New Upwork Team App
Fixed-Price - Intermediate ($$) - Est. Budget: $20 - Posted
I need someone to research all the dental offices within five specific zip codes in Florida, then put their name, address, city, state, zip and email address and website address into an Excel spreadsheet for me. Must have all of those separate columns. The zip codes are: 3306, 33609, 33615, 33629, and 33762 Please obtain the addresses through your traditional mining methods. But also search this site for additional information: http://www.mouthhealthy.org/
Skills: Web scraping Data Entry Data mining Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
Hello, I'm looking for someone to download all prices for every part, for all vehicle year/make/models. From an automotive parts site such as http://www.rockauto.com/en/catalog/ I would like it to be summarized in an excel spreadsheet, or itemized database that can be downloaded. Please let me know A) How you plan to do this (crawler, manually, etc) B) How long it will take you C) Price you will charge (can be more or less than $100)
Skills: Web scraping Web Crawler
Fixed-Price - Intermediate ($$) - Est. Budget: $35 - Posted
I need someone to scrape data from an retailer's website and then copy/paste the information into a spreadsheet. The basic steps to be performed are as follows: 1. Visit the retailer's website and enter a pre-defined query string. 2. The results from the search query will be a listing of the retailer's products. 3. Within the search results, access the webpage for a product by selecting it's hyperlink. 4. Copy/paste information about the product into a spreadsheet. 5. Repeat the copy/paste activity for the top 100 products listed in the search results
Skills: Web scraping Data Entry Data scraping Google Docs
Fixed-Price - Expert ($$$) - Est. Budget: $1,000 - Posted
create a data set that contains all cities and street names in those cities in Libya. In Latin writing (would be nice to have Arabic as well). Your dataset could for example be an excel sheet or a comma seperated file. Find location (address) of post offices in all around Libya and include in your dataset the PO Box numbers at those locations (e.g. PO Box # 2000 - 3500). See if you can also get house numbers on those streets in your data set.
Skills: Web scraping Data Analytics Data Entry Data mining
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
We have multiple clients who require data to be scraped from their website or specific websites. The data is then presented in a format that the client can use. The data is updated from the web scrape daily via cron jobs. We have ongoing work available for the right candidate. Must have experience in php web scraping, xml, csv, txt datafeeds and datafeed generation.
Skills: Web scraping Ecommerce Platform Development MySQL Administration MySQL Programming
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
We are looking to develop a PROOF OF CONCEPT script to capture the following from all vehicles on an automobile dealer website - { vin: <17 digit vehicle ID number, make: <vehicle make>, model: <vehicle model>, year : <vehicle year>, mileage: <mileage>, website: <website crawled> } OPTIONALLY, When a set of table data (key=value) is available, we'd like a structure containing this data. Example of this is "color", "engine", etc. Use the keys from the website. If they have a space, then "slug" them - ex. Exterior Color | White becomes " {exterior_color : "white} ". Data should be stored as JSON flat-files on our server at Amazon. Example website is ALL vehicles from.... https://porscheatlantaperimeter.com/inventory/ Vehicle Details Example ... https://porscheatlantaperimeter.com/inventory/Porsche+Boxster+Atlanta+Georgia+2015+Carrara+White+Metallic+531744 We believe there are numerous sites that use the same / similar structure. The project will be awarded to someone who can demonstrate an understanding of DOM parsing and regular expressions to achieve this. Phase 1 of project is a Proof of Concept that this website can be scraped. Bonus if script can work with other websites. NOTE: We have listed PHP
Skills: Web scraping Data scraping Regular Expressions
Fixed-Price - Entry Level ($) - Est. Budget: $150 - Posted
I need someone who can go through boxscores from each game in basketball and generate a CSV file with the stats for each player For example you would have to go to each day here: http://www.sports-reference.com/cbb/boxscores/index.cgi?month=2&day=7&year=2016 then go through each game listed there i.e find all the links with boxscores such as: http://www.sports-reference.com/cbb/boxscores/2016-02-07-canisius.html and then put all the stats for each player into a csv file. all the stats for all the players for all the teams would be combined into one sheet in excel file, and there would be a tab for each day. See image attached. Once all the current data is gathered, the script should be able to update the sheet daily with the previous days game logs. This is a very simple task that should take no more than 8-10 hrs. I need it done in the next few days. Additional possible work could include, creating a web app instead of the csv file, and do some additional calculations on the data, i would pay extra for this.
Skills: Web scraping Microsoft Excel Scripting
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
I need someone to compile a leads list of engineers who are currently working in engineering companies or research organizations. I also want a small leads list of student engineers. The leads need to fit these specifications: I want 50 leads from Adelaide, Australia I want 200 leads from anywhere else in Australia I want 200 leads from anywhere else in English speaking countries I want 100 student leads from anywhere in Australia I only want one engineer from each company/ organization/ university —I do not want multiple engineers that work at the same organization. The students should be sourced from at least 4 different Universities. I require the personal emails of each engineer. No emails that like “info@company.com,” “staff@engineeringconsultants.com,” or “clinic@gmail.com,” or anything of that sort. Use your best judgment for this and get personal-sounding emails like john.smith@company.com. Finding personal emails is the hard part. When scraping the Web, look for the personal email information first, and then look for all the other information associated with that engineer’s email. I require the following information from each engineer to be organized into an Excel sheet: name, email, phone number (this can be the company’s phone number), company/ organization name, company/ organization location and company/ organization/ university website. I am looking for a fixed price for a leads list of this magnitude. Please reply with your bid for the job. Bids of over $(70) will be ignored. Lowest bid or best sales pitch gets the job. *If you have read this description please tell me your favorite color in response to the screening question
Skills: Web scraping Data Entry Lead generation Microsoft Excel
Fixed-Price - Intermediate ($$) - Est. Budget: $250 - Posted
I need help in scrapping university websites sites for email address. This is a low weight work. The code can be written in any language, preferably in Ruby. I will need a csv file in the format, i specify. I will also specify the sites and techniques to scrape as i have done this before. There are close to 30 sites, you will be needing to scrape from. I will give you the university name and you will need to get names from university facebook group or use common names that i can provide. Find the student directory page for that university and use that for searching and fetching the email and other meta information from the results
  • Number of freelancers needed: 2
Skills: Web scraping Data scraping HTML JavaScript
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App