You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

50 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Looking for the Team App?
Download the New Upwork Team App
Fixed-Price - Expert ($$$) - Est. Budget: $50 - Posted
I'm going to Angola, a Portuguese speaking country, and need someone to conduct some research (within financial services/ banking and telecommunications) on this country, some important individuals and other aspects of these industries. A lot of this information will be in Portuguese and I need someone with excellent research skills - web research/ deep mining - and native (or near native) Portuguese: written, reading and speaking. Ideally the individual will have lived or live in Angola - though this is not completely necessary. I'll provide you with the list of names (approx. 10) , companies/ societies (approx. 10) and specific details on the aforementioned industries. I'd need this work completed by: 16th February. It should be presented in a table either using MS Word or Excel. All to be written in English. Please ask any needed questions. Price given is negotiable depending on skill, expertise, and speed of delivery.
Skills: Web Crawler Data scraping Internet research Market research
Hourly - Intermediate ($$) - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
i will provide company name and potential job titles to look for per company you will find exact name, job title add to columns in existing spreadsheet example of what i will provide: company name: google company domain: google.com title(s) to look for: ceo you will return in two columns (column A = name1, column b = title1): name, title: sundar pichai, ceo this must be done in bulk and automatically as new rows are added to sheet if i have a list of 100 company and/or domains you should be able to return accurate results in minutes or seconds for all results this is not a manual job you can create scraper, crawler, api whatever i just need fast, accurate, consistent results
Skills: Web Crawler Web Crawling Data scraping Scrapy
Hourly - Expert ($$$) - Est. Time: Less than 1 month, 30+ hrs/week - Posted
I am in need of hotel, restaurants lists with Business, Email, Website (optional). Countries: USA,UK, France, Italy, Spain Turkey, UAE, Australia, Japan, Brasil. Email type: Manager's emails or Generic e.g. (reservation@; info@; frontdesk@; reception@; rsv@; etc..) ONLY APPLY IF YOU HAVE OR CAN GET MORE THAN 1000 CONTACTS A DAY. We consider acquiring existing databases too, only large ones.
  • Number of freelancers needed: 3
Skills: Web Crawler Data mining Data scraping Email Marketing
Hourly - Expert ($$$) - Est. Time: Less than 1 month, 30+ hrs/week - Posted
I am in need of hotel database with Hotel Name, Email. Countries: USA,UK, France, Italy, Australia, Japan, Brasil. Email type: generic e.g. (reservation@; info@; frontdesk@; reception@; rsv@; etc..) Existing databases are accepted too.
  • Number of freelancers needed: 3
Skills: Web Crawler Data mining Data scraping Email Marketing
Hourly - Expert ($$$) - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
I need a professional to scrape Commercial Real Estate listings from thousands of websites. I will provide the website lists. The data will be in different levels of the website. I need a dynamic crawl that can locate the data for every website at any level and scrape it. Below are the fields I'm looking for. In addition, I will provide a sample website list (around 500) to test when I hire the appropriate professional. The output will be primarily be CSV Data to Scrape: Property Address price property type (Exclude Residential and Business for Sale) property description Building size (Sq ft) Sale / Lease (rent) Property Image broker name Broker Phone # Broker Email Website copyright (if has copyright need to flag "Y") Privacy (if has privacy need to flag "Y") terms and conditions (if has Terms and Conditions need to flag "Y") Original Scrape Date
Skills: Web Crawler Data mining Data scraping Web scraping
Fixed-Price - Entry Level ($) - Est. Budget: $200 - Posted
We need to develop a PHP script that crawls craiglist website. Must work as a bot. The script must do: 1) The bot must crawl all cities in craiglist on the selected craiglist section (vacation rentals) and retrieve all the data of each apartment (including email, photos, text, features and owner data). 2) The bot will insert the crawled data into our database (mysql). - First creating the user with the data in craiglist and then the apartment data. 3) Send email to inform about the listing to the owner. Our site is developed in CakePHP and the coder can help with the step 2).
  • Number of freelancers needed: 2
Skills: Web Crawler CakePHP Web Crawling MySQL Programming
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
Looking for someone experience with Amazon Product advertising api before, to develop very simple tool where 1. user enter keywords and some filter 2. tool uses keyword API to display results 3. and then use ASIN lookup to get prices from different marketplace and display results.. 4. what is usually limitation on number of calls per hour or second for this API if you know ? I will provide access to linux server.. I already have tool that uses scraping but scraping has lot of issues, so decide to switch to API http://ec2-52-53-228-149.us-west-1.compute.amazonaws.com/search Tool doesn't have to be copy of this As tool should display data in html table with excel export option.. Only apply if you are available whole day today and finish tool today ... Ideally its just JSON / XML phrasing snd saving data in db... 1. please send me link/explaination of previous amazon ads API work 2. what language will you code (prefer php , python or node.js java ) 3. confirm you can work whole day oon this and finish it, Buget : $50
Skills: Web Crawler API Development JavaScript json
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
Crawl website for content extraction and provide extracted content in various format such as Microsoft Excel (.xls), XML, Microsoft Access (.mdb), SQL, etc. - Will be collecting data such as Real Estate Properties - Must have experience with Scrapy and Scrapinghub Platform - Setup scraped files and images to FTP server - Salesforce API Integration and Resolving Formatting Issues
Skills: Web Crawler Data mining Data scraping Python
Hourly - Intermediate ($$) - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
I am looking for a program that will crawl through the websites of companies and extract all of the job listings. I do not have a list of companies to crawl, and therefore, the solution should include a crawler that will collect the websites of all companies in the USA. To start, we can just have New York City, but I would eventually want to scale to teh whole country This would basically be to take everything from examplecompany.com/jobs or examplecompany.com/careers or similar sites and organize all of the results in a database. The crawler should be easy to run on a daily or weekly basis.
Skills: Web Crawler Data scraping
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App