You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

57 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Hourly - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
We're a consumer electronics startup prepping up our pre-sales campaign. We need someone to harvest emails or sell us lists for the following customer segments. - Teachers, principals at elementary, middle and secondary schools. - Emails from home-school associations - Emails from crowdfunding enthusiasts (fans, professionals, businesses, bloggers, etc.). - Incubators, accelerator programs for tech hardware, artificial intelligence and robotics Our geographical markets are: UAE, Saudi Arabia, India, Germany, UK, USA, Canada, Australia. You can sell us your existing lists.
Hourly - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We are a single-unit retailer based in Denver, CO looking for an experienced web/software developer who can build a web-based tool to help us extract a number of pieces of information from our local competitor’s e-commerce websites. Specifically, we need to build the tool to track the prices of our competitors’ products vs. our products, and therefore need to extract information on: product name, description, size, price, sale price, and potentially other variables. There are 5-10 competitor sites that we would like to extract information from with this tool, and each site has thousands of items for sale on it. We would like to be able to run the tool at any time manually and also have it run automatically, and would like the data output to be stored and presented in an Excel-like grid format within the web tool and also be downloadable into Excel format. Because we expect our competitors’ websites to change over time, we will need to develop a flexible extraction tool and/or agree...
Fixed-Price - Est. Budget: $ 6 Posted
I will provide you with a spreadsheet of 100 records that has the following information: Company, Website, Contact Name, Address, City, State, Zip Code. The task is to find the correct email for the contact. The email address needs to be for the contact specifically. Generic email addresses such as the following are of no use. info@abc.com, help@abc.com, etc. Accuracy is VERY important. If you cannot find an email, put a dash (-) in the spreadsheet and move on to the next record. Each project will be 100 records to work and will pay $6. This will be ongoing work. I would prefer working with those that have Skype. All applicants MUST go to the link below to take a test which will be identical to the job. This test has 35 questions. You will NOT be considered if you do not take the test and score well. Once you have taken the test, feel free to message me with your results and I will be in touch. Again, this will be ongoing work. Look forward to hearing from you. https://www.proprofs.com/quiz-school/story.php?title=email-test-1
Fixed-Price - Est. Budget: $ 300 Posted
We are looking to crawl a large repository of event vendors: Wedding Wire. From this repository the contractor will need to extract Company Name, Website (if available), Phone (if available), Company Type, City, and State. Once this is complete, there are many other sites we would like to scrape as well if the contractor is motivated.
Fixed-Price - Est. Budget: $ 1,000 Posted
We have a number of well-defined scraping tasks that need to be integrated into our main online lending system Step 1 (This job): The HTML sample to be scraped and stored to XML and/or RDMBS attached Step 2 (Future) https://help.xero.com/uk/Payments_YodleeFeeds This is one time test project but the chosen team / candidate should get a long term assignment to build something called Yodlee with thousands of hours of work as we need to integrate with multiple sources Please send examples of you past work and estimation how long would it take to convert the attached file to clean XML Our current architecture is in Grails but we would consider scrapers in other languages in addition to Groovy, such as Python (http://www.crummy.com/software/BeautifulSoup/), Ruby or PHP The users will be interviewed technically and the key criterion is development speed and quality