You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Crawlers Jobs

45 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only

Fixed-Price - Est. Budget: $ 80 Posted
I need to scrape newly added business listings from www.gumtree.com.au on a daily basis. The daily data must be provided to me in a CSV/Excel file. Data must be unique and must have phone numbers. Please go through the attachment of sample output structure. The job has a potential to go on for several years provided quality and consistency is maintained. Note: Apply only if you have done this previously and have a credible solution to overcome the obvious challenges of blocking as well as AU IP restrictions. if you wish to be considered, I would suggest trying out for a 2-3 days by giving me daily sample records. This will give me idea of your capability. Who ever bids $80 or below will be hired immediately This is a long term job and if succeeded and if cost is reasonable it will go on for years. Regards, Wantro

Fixed-Price - Est. Budget: $ 40 Posted
I will provide you a certain web site and some keywords. when you input the keyword, results will be listed. this job is to open one of the listing and extract some information. bot have to run with Chrome and require fast speed . do not apply this job who are not expert and have to finish it in 2 days. Please check the detailed job description attachment shown below. Whoever bids $40 or less will be hired immediately.!!

Fixed-Price - Est. Budget: $ 1,000 Posted
We have a number of well-defined scraping tasks that need to be integrated into our main online lending system Step 1 (This job): The HTML sample to be scraped and stored to XML and/or RDMBS attached Step 2 (Future) https://help.xero.com/uk/Payments_YodleeFeeds This is one time test project but the chosen team / candidate should get a long term assignment to build something called Yodlee with thousands of hours of work as we need to integrate with multiple sources Please send examples of you past work and estimation how long would it take to convert the attached file to clean XML Our current architecture is in Grails but we would consider scrapers in other languages in addition to Groovy, such as Python (http://www.crummy.com/software/BeautifulSoup/), Ruby or PHP The users will be interviewed technically and the key criterion is development speed and quality

Hourly - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
We will provide you with a guide containing detailed information on how to scrape certain sites. These sites contain lists of different bars in different cities. The information you obtain will be posted on a google doc with the following: Name, location, type, phone number, etc.

Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
We need to grab PDF links and descriptions from various sites, to build a catalog which will be used to improve our positions in the search engines output. This catalog should be kept up-to-date. Please describe your typical approach, technical stack, any additional functionality (captcha, proxy support, UFT support, etc) that might be needed for this project. What are hardware requirements for your solution (VM size)? Please estimate baseline implementation, and the cost of adding new sites. We’ll need a code sample from you to make an informed decision.

Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
We are a single-unit retailer based in Denver, CO looking for an experienced web/software developer who can build a web-based tool to help us extract a number of pieces of information from our local competitor’s e-commerce websites. Specifically, we need to build the tool to track the prices of our competitors’ products vs. our products, and therefore need to extract information on: product name, description, size, price, sale price, and potentially other variables. There are 5-10 competitor sites that we would like to extract information from with this tool, and each site has thousands of items for sale on it. We would like to be able to run the tool at any time manually and also have it run automatically, and would like the data output to be stored and presented in an Excel-like grid format within the web tool and also be downloadable into Excel format. Because we expect our competitors’ websites to change over time, we will need to develop a flexible extraction tool and/or agree...