You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Scraping Jobs

233 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Looking for the Team App?
Download the New Upwork Team App
Fixed-Price - Intermediate ($$) - Est. Budget: $60 - Posted
I would like studies/ research details going back no more than 10years on the following topics: Total Reward, Leadership, and Recruitment and Selection. Send the summary of the study (a few lines), the location of the source (journal/ newspaper name, date, edition, etc. & webline if possible) For each of the topics look at aspects related to: >> TOTAL REWARD: How salary is determined, bench marking salary, employee benefits, most common benefits, learning and development initiatives, most/ least liked benefits, fixed pay packages/ commission - which circumstances are these used. Also, which type of environments are most conducive to get people to do their best work. Looking at lighting, ergonomics, noise/ sound etc. >> RECRUITMENT AND SELECTION: best/ worst techniques, length of time, most popular methods, how to recruit for potential, how to spot a liar, popular techniques used by innovative technology companies etc. >> LEADERSHIP: most recent theories on leadership, how to manage junior staff, how to manage those more powerful/ influential than you (e.g. senior staff, stakeholders, shareholders/ equity holders), challenges of a leader - the best ways to cope, the different types of leaders etc. Please gather research from credible sources: journals, newspapers, magazines, government reports etc. The research is to be focussed on data obtained from the Western world - Europe and Northern America. Use studies which have been cited the most or which are interesting and unique. Ideally, the person doing this study will have access to journals rather than just look at summaries via google scholar. I need to see the original source not summaries made by another person. Create them in a list format on MS Excel, with each area having its own tab. I'd like at least 15 studies/findings on each of these 3 three areas.
Skills: Web scraping Data Entry Internet research Microsoft Excel
Hourly - Expert ($$$) - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
I have a csv / excel file with approximately 500,000 records. For approximately 150,000 of these records I have: -Real name of user -Reported location (city, country) of user For approximately 50,000 records of these 50,000 records I have some combination of: -facebook profile id -twitter handle -website they own or are associated with (personal or business website) The job is to match email addresses to these records for as many of these records as possible using webscraping or other available databases/sources of information. please see sample data attached
Skills: Web scraping Data mining Data scraping Email Marketing
Fixed-Price - Entry Level ($) - Est. Budget: $50 - Posted
I need you to login to an https website in python so that screenshots can be taken and or the html downloaded. I have some very poorly written code but just don't have the time to learn how to do this myself.
Skills: Web scraping Python
Fixed-Price - Intermediate ($$) - Est. Budget: $200 - Posted
I need someone to extract/scrape contact information from agents on Zillow into an excel sheet. I need real estate agents' contact information from Zillow. You will have to go on Zillow.com, and collect the following data from all Zillow agents accross the united states. First name Last name Email Phone number Website City State Numbers of past sales per year This information will need to be collected on an excel sheet. You need to have a system in place to scrape website data on multiple pages quickly.
Skills: Web scraping Data mining Data scraping Internet research
Hourly - Entry Level ($) - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
We operate in the property industry with our clients being estate agents. Some time ago, we developed an Asp.Net / C # application to simulate the uploading of property listings to Gumtree which meant that our clients could automate the uploading procedure without having to manually do so. Our present application was developed by a Freelancer Consultant who used Fiddler to interpret (scrape) the way that the Gumtree site works: www.gumtree.co.za. Earlier this week, our application began encountering problems with the login procedure due no doubt to Gumtree changing the way that their site is working. We need someone with extensive experience in Fiddler and / or Scraping to debug the code and get it to work again. Also, we would like to add further functionality into this application so that it will work server side, called from a web based parent application / website. Project Urgency: HIGH ESSENTIAL Other Requirements: Contactable on Skype for talking. You must be able to communicate with us easily and effectively.
Skills: Web scraping Data scraping
Fixed-Price - Expert ($$$) - Est. Budget: $25 - Posted
Hi there! We are looking for assistance on a simple data scoring project. You will need to sort through a spreadsheet, checking the LinkedIn profiles of included companies. Once you have identified the industry, you will need to asses the size of the sales team of that company. This can be done through checking the checking LinkedIn.
  • Number of freelancers needed: 3
Skills: Web scraping Data Entry Internet research LinkedIn Development
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
We wish to gather all the key data of Beauty Salon / Hair Salons for 4 India cities: Bangalore, Mumbai, Chennai, and Hyderabad. For each listing we want the following information loaded into a spreadsheet which will be provided for our review: Category Name Business Name Owner or Lead Contact Name Phone Number Email Website URL Street Address City State Postal Code Open Hours Description of the Business Facebook Link Google Plus Link Twitter Link We would like to have the scraping done by Wednesday 10 February. We would like you to recommend a website which you feel would be the best source for this information and explain why. Some possibilities are listed below, but if you have another site that you would like to suggest, please do. http://www.sulekha.com/ - Mixed http://www.yellowpages.in/ - Mixed http://www.justdial.com/ - Mixed http://www.indiamart.com/ - Small and medium enterprises http://www.tradeindia.com/ - Mixed In your proposal, submit a sample of 500 records captured from your suggested website to prove that you can gather the information. Also, if you can let us know how many records you expect to get from the website, it will help justify your pricing. Upon completion, we will review the spreadsheet to validate that the information is complete and accurate. If there are issues we will point them out. Once all issues are resolved, you will be paid. This will be a fixed bid project. Please provide your bid for the entire project. Also, please indicate the date by which you can deliver the completed spreadsheet.
Skills: Web scraping Data mining Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $35 - Posted
I'm looking for a regular expression to scrape the URLs that appear on page 1 of Google search results for any search query. I have a Ruby on Rails project where I'm using Nokogiri for scraping. I am grabbing the Google SERP like this: doc = Nokogiri::HTML(open("http://www.google.com/search?q=#{search_keyword}")) Then I get the page 1 search results like this: doc.xpath('//*[contains(concat( " ", @class, " " ), concat( " ", "r", " " ))]//a') This mostly works, but I need to EXCLUDE a couple things: 1) Exclude the excerpt/snippet google sometimes includes as result #1 2) Exclude sitelinks Google sometimes includes under result #1 See the attached pic for examples of these exclusions. At the end of the project, I will consider it a success if I can plug the regex or xpath into Nokogiri and get the desired results based on my specifications.
Skills: Web scraping Regular Expressions
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
We wish to gather all the key data of Play Schools for 4 India cities: Bangalore, Mumbai, Chennai, and Hyderabad. For each listing we want the following information loaded into a spreadsheet which will be provided for our review: School Name Owner or Lead Contact Name Phone Number Email Website URL Street Address City State Postal Code Open Hours Description of the School Facebook Link Google Plus Link Twitter Link We would like to have the scraping done by Wednesday 10 February. We would like you to recommend a website which you feel would be the best source for this information and explain why. Some possibilities are listed below, but if you have another site that you would like to suggest, please do. http://www.sulekha.com/ - Mixed http://www.yellowpages.in/ - Mixed http://www.justdial.com/ - Mixed http://www.indiamart.com/ - Small and medium enterprises http://www.tradeindia.com/ - Mixed In your proposal, submit a sample of 500 records captured from your suggested website to prove that you can gather the information. Also, if you can let us know how many records you expect to get from the website, it will help justify your pricing. Upon completion, we will review the spreadsheet to validate that the information is complete and accurate. If there are issues we will point them out. Once all issues are resolved, you will be paid. This will be a fixed bid project. Please provide your bid for the entire project. Also, please indicate the date by which you can deliver the completed spreadsheet.
Skills: Web scraping Data scraping
Hourly - Entry Level ($) - Est. Time: More than 6 months, 10-30 hrs/week - Posted
Freelancer will receive a list of 100 client prospects. He/she must do some research online to help us find the gold nuggets in that list. 1. Go to the company's website. 2. Go to the company's career page. 3. Search for IT (Information Technology / Technology) jobs in targeted location. 4. Save the link and/or take a screenshot when the company has posted at least one IT job. 5. Disregard the leads that don't post IT jobs. Strong performers will receive repeat business every week.
  • Number of freelancers needed: 2
Skills: Web scraping Microsoft Excel Research
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App