You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Scraping Jobs

231 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Looking for the Team App?
Download the New Upwork Team App
Hourly - Intermediate ($$) - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
PROJECT OVERVIEW: We are currently working on an infographics campaign to promote our business, and we need an expert web researcher who has experience in the area of home safety/monitoring/security. JOB DETAILS: There are 3 parts to this job. Part 1 is... I'm looking for someone who can gather statistics on property crimes and home invasion of each US state for the last 10 years. Data should include but not limited to the following: • demographics. • time & exact location. • number of accomplice on a single crime committed. • tool(s) used for the crime. • point of entry • how often they commit same crime on the same house/place. • the estimated cost of the properties stolen. • stats on domestic violence committed by burglars. • how many burglary cases are solved each year. Add whatever information you think is worthy of mentioning like how they plan their burglary. -------------------------------------------- Part 2 of this job is: Statistics on the average spending of Americans per state when it comes to home security for the last 10 years. Data to show: • annual income. • number of family members. • how much is spent on home security gadgets/services/mobile application. • have record of intruder reports • have record of burglary reports. And then... Stats on how much they spend (per state) on luxury like: • gadgets • car • home improvement • home accessories • personal items. -------------------------------------------- Part 3 of this job is: Make a list of top 100 safest cities in the US for the last 10 years. The listing should be based on the stats below: population stats on violent crimes stats on property crimes stats on burglary & home invasion number of burglary & home invasion cases solved. The ranking should be according to the stats of the crimes recorded versus the number of cases solved for the last 10 years. -------------------------------------------- A couple things. You should be able to cite all the sources of the data you will gather. We will use them as reference material. When you apply mention "I have the expertise" in the first paragraph of your cover letter. Also, give me an overview of your process and how soon can you deliver the first set of data. I’m looking for someone who can work on this right away as we may have future projects together if things go well. See you on the other side! Rock on!
Skills: Web scraping Big Data Data Entry Data mining
Fixed-Price - Intermediate ($$) - Est. Budget: $60 - Posted
I would like studies/ research details going back no more than 10years on the following topics: Total Reward, Leadership, and Recruitment and Selection. Send the summary of the study (a few lines), the location of the source (journal/ newspaper name, date, edition, etc. & webline if possible) For each of the topics look at aspects related to: >> TOTAL REWARD: How salary is determined, bench marking salary, employee benefits, most common benefits, learning and development initiatives, most/ least liked benefits, fixed pay packages/ commission - which circumstances are these used. Also, which type of environments are most conducive to get people to do their best work. Looking at lighting, ergonomics, noise/ sound etc. >> RECRUITMENT AND SELECTION: best/ worst techniques, length of time, most popular methods, how to recruit for potential, how to spot a liar, popular techniques used by innovative technology companies etc. >> LEADERSHIP: most recent theories on leadership, how to manage junior staff, how to manage those more powerful/ influential than you (e.g. senior staff, stakeholders, shareholders/ equity holders), challenges of a leader - the best ways to cope, the different types of leaders etc. Please gather research from credible sources: journals, newspapers, magazines, government reports etc. The research is to be focussed on data obtained from the Western world - Europe and Northern America. Use studies which have been cited the most or which are interesting and unique. Ideally, the person doing this study will have access to journals rather than just look at summaries via google scholar. I need to see the original source not summaries made by another person. Create them in a list format on MS Excel, with each area having its own tab. I'd like at least 15 studies/findings on each of these 3 three areas.
Skills: Web scraping Data Entry Internet research Microsoft Excel
Hourly - Expert ($$$) - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
I have a csv / excel file with approximately 500,000 records. For approximately 150,000 of these records I have: -Real name of user -Reported location (city, country) of user For approximately 50,000 records of these 50,000 records I have some combination of: -facebook profile id -twitter handle -website they own or are associated with (personal or business website) The job is to match email addresses to these records for as many of these records as possible using webscraping or other available databases/sources of information. please see sample data attached
Skills: Web scraping Data mining Data scraping Email Marketing
Fixed-Price - Entry Level ($) - Est. Budget: $50 - Posted
I need you to login to an https website in python so that screenshots can be taken and or the html downloaded. I have some very poorly written code but just don't have the time to learn how to do this myself.
Skills: Web scraping Python
Fixed-Price - Intermediate ($$) - Est. Budget: $200 - Posted
I need someone to extract/scrape contact information from agents on Zillow into an excel sheet. I need real estate agents' contact information from Zillow. You will have to go on Zillow.com, and collect the following data from all Zillow agents accross the united states. First name Last name Email Phone number Website City State Numbers of past sales per year This information will need to be collected on an excel sheet. You need to have a system in place to scrape website data on multiple pages quickly.
Skills: Web scraping Data mining Data scraping Internet research
Hourly - Entry Level ($) - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
We operate in the property industry with our clients being estate agents. Some time ago, we developed an Asp.Net / C # application to simulate the uploading of property listings to Gumtree which meant that our clients could automate the uploading procedure without having to manually do so. Our present application was developed by a Freelancer Consultant who used Fiddler to interpret (scrape) the way that the Gumtree site works: www.gumtree.co.za. Earlier this week, our application began encountering problems with the login procedure due no doubt to Gumtree changing the way that their site is working. We need someone with extensive experience in Fiddler and / or Scraping to debug the code and get it to work again. Also, we would like to add further functionality into this application so that it will work server side, called from a web based parent application / website. Project Urgency: HIGH ESSENTIAL Other Requirements: Contactable on Skype for talking. You must be able to communicate with us easily and effectively.
Skills: Web scraping Data scraping
Fixed-Price - Expert ($$$) - Est. Budget: $25 - Posted
Hi there! We are looking for assistance on a simple data scoring project. You will need to sort through a spreadsheet, checking the LinkedIn profiles of included companies. Once you have identified the industry, you will need to asses the size of the sales team of that company. This can be done through checking the checking LinkedIn.
  • Number of freelancers needed: 3
Skills: Web scraping Data Entry Internet research LinkedIn Development
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
We wish to gather all the key data of Beauty Salon / Hair Salons for 4 India cities: Bangalore, Mumbai, Chennai, and Hyderabad. For each listing we want the following information loaded into a spreadsheet which will be provided for our review: Category Name Business Name Owner or Lead Contact Name Phone Number Email Website URL Street Address City State Postal Code Open Hours Description of the Business Facebook Link Google Plus Link Twitter Link We would like to have the scraping done by Wednesday 10 February. We would like you to recommend a website which you feel would be the best source for this information and explain why. Some possibilities are listed below, but if you have another site that you would like to suggest, please do. http://www.sulekha.com/ - Mixed http://www.yellowpages.in/ - Mixed http://www.justdial.com/ - Mixed http://www.indiamart.com/ - Small and medium enterprises http://www.tradeindia.com/ - Mixed In your proposal, submit a sample of 500 records captured from your suggested website to prove that you can gather the information. Also, if you can let us know how many records you expect to get from the website, it will help justify your pricing. Upon completion, we will review the spreadsheet to validate that the information is complete and accurate. If there are issues we will point them out. Once all issues are resolved, you will be paid. This will be a fixed bid project. Please provide your bid for the entire project. Also, please indicate the date by which you can deliver the completed spreadsheet.
Skills: Web scraping Data mining Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $35 - Posted
I'm looking for a regular expression to scrape the URLs that appear on page 1 of Google search results for any search query. I have a Ruby on Rails project where I'm using Nokogiri for scraping. I am grabbing the Google SERP like this: doc = Nokogiri::HTML(open("http://www.google.com/search?q=#{search_keyword}")) Then I get the page 1 search results like this: doc.xpath('//*[contains(concat( " ", @class, " " ), concat( " ", "r", " " ))]//a') This mostly works, but I need to EXCLUDE a couple things: 1) Exclude the excerpt/snippet google sometimes includes as result #1 2) Exclude sitelinks Google sometimes includes under result #1 See the attached pic for examples of these exclusions. At the end of the project, I will consider it a success if I can plug the regex or xpath into Nokogiri and get the desired results based on my specifications.
Skills: Web scraping Regular Expressions
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App