You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Crawlers Jobs

56 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Hourly - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We are a single-unit retailer based in Denver, CO looking for an experienced web/software developer who can build a web-based tool to help us extract a number of pieces of information from our local competitor’s e-commerce websites. Specifically, we need to build the tool to track the prices of our competitors’ products vs. our products, and therefore need to extract information on: product name, description, size, price, sale price, and potentially other variables. There are 5-10 competitor sites that we would like to extract information from with this tool, and each site has thousands of items for sale on it. We would like to be able to run the tool at any time manually and also have it run automatically, and would like the data output to be stored and presented in an Excel-like grid format within the web tool and also be downloadable into Excel format. Because we expect our competitors’ websites to change over time, we will need to develop a flexible extraction tool and/or agree...
Hourly - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
The Revitalizing Rainfed Agriculture (RRA) Network is seeking multiple applicants with scraping skills with data/web scraping skills to acquire and compile multiple agriculture related public datasets for its open data repository. Some datasets require more advanced skills than others. For example, in some cases the scrapers would be required to write automated scripts to scrape data from multiple websites ( written in different server side languages) and compile the datasets in a suitable open format (such as csv), while in some cases, the data can be downloaded manually one query at a time and subsequently rearranged and compiled. The data and the scripts will then be available for use in the public domain. Here are some of the websites from which data needs to scraped: Based on skill-sets and time considerations applicants can choose to apply to work on one or more datasets: 1) Agriculture Census (http://agcensus.dacnet.nic.in/TalukCharacteristics.aspx) The data needs to be...
Fixed-Price - Est. Budget: $ 6 Posted
I will provide you with a spreadsheet of 100 records that has the following information: Company, Website, Contact Name, Address, City, State, Zip Code. The task is to find the correct email for the contact. The email address needs to be for the contact specifically. Generic email addresses such as the following are of no use. info@abc.com, help@abc.com, etc. Accuracy is VERY important. If you cannot find an email, put a dash (-) in the spreadsheet and move on to the next record. Each project will be 100 records to work and will pay $6. This will be ongoing work. I would prefer working with those that have Skype. All applicants MUST go to the link below to take a test which will be identical to the job. This test has 35 questions. You will NOT be considered if you do not take the test and score well. Once you have taken the test, feel free to message me with your results and I will be in touch. Again, this will be ongoing work. Look forward to hearing from you. https://www.proprofs.com/quiz-school/story.php?title=email-test-1
Fixed-Price - Est. Budget: $ 300 Posted
We are looking to crawl a large repository of event vendors: Wedding Wire. From this repository the contractor will need to extract Company Name, Website (if available), Phone (if available), Company Type, City, and State. Once this is complete, there are many other sites we would like to scrape as well if the contractor is motivated.
Fixed-Price - Est. Budget: $ 1,000 Posted
We have a number of well-defined scraping tasks that need to be integrated into our main online lending system Step 1 (This job): The HTML sample to be scraped and stored to XML and/or RDMBS attached Step 2 (Future) https://help.xero.com/uk/Payments_YodleeFeeds This is one time test project but the chosen team / candidate should get a long term assignment to build something called Yodlee with thousands of hours of work as we need to integrate with multiple sources Please send examples of you past work and estimation how long would it take to convert the attached file to clean XML Our current architecture is in Grails but we would consider scrapers in other languages in addition to Groovy, such as Python (http://www.crummy.com/software/BeautifulSoup/), Ruby or PHP The users will be interviewed technically and the key criterion is development speed and quality