You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

58 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Hourly - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
I have a list of companies, as well as phone numbers and addresses, that I am looking to find President/CEO name and email address. I have a second list of names and companies, but also need to find email addresses. I am looking for someone who has the technology to find these addresses through a crawler. NOTE: I am NOT looking for someone to manually find them. I am also NOT looking for someone who uses LinkedIn to find email addresses. *** The most important part of this job is to find accurate email addresses. I would like to try someone out first for 3-5 hours and see how they do before committing to more databases.
Fixed-Price - Est. Budget: $ 200 Posted
In order to make a marketing campaign for entrepreneurs, we need to extract all data from a public database (http://www.registreentreprises.gouv.qc.ca/en/). We would like to have a spreadsheet created where we could find all the information of the database, instead of constantly using the searching tool. To give you an idea of how the tool works manually, I provided in attachment the process. You can try searching for "Universite Laval" or "Peintre etudiant" to test the site. We will want to update the information in our spreadsheet once or twice a year, so the hired freelancer can expect to be contacted again in the future to repeat a similar task. You might create a very heavy spreadsheet because of the tons of information contained on the database. We want someone that will take the time to make sure the data is correct and clean, so we don't have more work to do once we receive the file.
Hourly - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
We are looking to create a simple database of property characteristics for a fairly limited region in upstate NY. We are looking to scrape property details (fields like square footage, # of bedrooms, price, rent, etc) from a few sites including: http://www.realtor.com/ http://catskillmountainrealty.com/index.html This can be done manually though doing it in some kind of automated fashion is slightly preferred.
Fixed-Price - Est. Budget: $ 1,000 Posted
I am looking for an experienced developer who can create a domain crawler which can find expired domains. There is also some actions that need to be done by a bot programme before the results are entered into the crawler, also Integrate APIs into the software. Here is a video walking you through the process http://acen.evsuite.com/domain-crawler-walk-through/ and a mindmap which maps out the process on which the bot will take https://mm.tt/577239483?t=PBIN2YycKN The successful developer will need to be able to speak and understand good English and will be required to have a Skype interview with us. Communication throughout the project is a essential factor. A proven track record in this type of development is essential factor. Please reply with an understanding of how you would achieve this work. Please spell your name backward at the beginning of your covering letter or you will not be considered. If you are an agency please do not apply.
Fixed-Price - Est. Budget: $ 250 Posted
I need a CSV file Containing a list of all businesses in Australia State (required) City/Suburb (required) Post Code (required) Business Name (required) Business Sector or Type (required) Business Logo (if available) Business Description (if available) Address (required in virtually all cases) Phone Number (required) Website (if available) Email(if available) Creating a Directory Please quote hours and cost in your response Thanks, Don
Fixed-Price - Est. Budget: $ 200 Posted
Looking for someone to recreate a section of Amazon.com bestsellers for our site. This will recreate the six tab directory seen here and populate it with our affiliate code on images and links. Each Category and subcategory has 100 items displayed across 10 pages each. There are roughly 30 Categories, each with five pages of products. with up to 5 subcategories each. Project will be done utilizing Fresh Store Builder. I will send you a link with the section to be recreated. Prefer candidates with strong Amazon Web Services, API and Fresh Store Builder experience. You must adhere to deadlines and have good English communication skills. Job Summary 1)Set up a Wordpress CMS install our our VPS 2)Make that installation a Multisite Install 3)Set up primary and secondary domain (the top 100 will be under our primary domain. 4)Set up an index page with Amazon Top Rated, categories and subcategories. Along with Index tabs across the top of the page. (we will provide this link, LOOK...
Fixed-Price - Est. Budget: $ 60 Posted
Write 4 scripts to extract data from dinamic webs, Use web scraping to get data from productos from some web stores: The webs to scrap are: 1.- Wallmart http://www.walmart.com.mx/super/Busqueda.aspx?Departamento=d-Carnes-y-Pescados&Familia=f-Carne-de-res&Linea=l-Cortes 2.- Superama. http://www.superama.com.mx/superama/inicio.aspx 3.- Comercial Mexicana https://www.lacomer.com.mx/lacomer/doHome.action?key=Lomas-Anahuac&succId=14&succFmt=100 4.- Soriana http://www1.soriana.com/site/default.aspx?p=12118&temprefer=25134415 You will get such data for México. Superama and Wallmart have the same price and products for every store on México. Comercial Mexicana and Soriana have diferent prices and products for each store on México, so you have to get the data for each store. –You will get for every web (if apply) the following information: (State, city, store, department, category subcategory, product name, price, amount/measure, presentation, branch and price.) –Only...
Fixed-Price - Est. Budget: $ 40 Posted
Expert Data Scraper $40/h Title: Expert Data Scraper $40/h Criteria: We only work with the absolute best We are looking for an Expert Data Scraper We will have more advanced tasks in Data Scraping if results are 10/10 Work instructions: 1. Work with virtual team in Asana 2. Complete every task in project 10/10 3. From scraping first data first to uploading finished project Hiring process: 1. Answers to screening questions 2. Complete interview process demo 3. Complete $40/1h fixed price project 4 Work as long term hire for $40/h for 40h/week Comment: We will look at all applications Hope you are okay Thanks a lot :))
Fixed-Price - Est. Budget: $ 200 Posted
Looking for someone to recreate a section of Amazon.com bestsellers for our site. This will recreate the six tab directory seen here and populate it with our affiliate code on images and links. Each Category and subcategory has 100 items displayed across 10 pages each. There are roughly 30 Categories, each with five pages of products. Project will be done utilizing Import.io and/or the Amazon API, and resulting data will be implemented within our Wordpress on our VPS. I will send you a link with the section to be recreated. Prefer candidates with strong Amazon Web Services, API and Import.io experience. You must adhere to deadlines and have good English communication skills. Ideal candidate would also have app development skills on iOS, Facebook, Web Apps, and Android, and should be able to advise us on best practices for future uses of scraped data. We want both the product images and the product detail information retrieved by your webcrawler and resulting data sets to be...