You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

19 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
We are looking for someone to source products for our Amazon business for private labeling and/or products to sell on Amazon through approaches such as purchasing direct from a supplier like (Alibaba). The categories we are interested in are as follows: Health & Beauty, Travel, Home, Tools & Home Improvement, Automotive or Patio, Lawn & Garden. We would like someone that is proficient in at least one or two of these categories. Meaning you are very familiar with and have done searching in these categories extensively. We are most interested in your experience in dealing with Alibaba. Specifically, we are looking to source a product that we can make our own i.e. (private labeling ) or sell on Amazon without private labeling. When you find a product we ask that you check the top 3 in sales ranks, number of reviews, average selling price, weight of product, then once we decide on a product we will have you talk to Alibaba suppliers (Gold & Preferred and on onsite verified) and...

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Hello, I'm seeking an experienced data mining professional, who can compile specific data lists that will be converted to leads for a call center business. I would be able to provide the insight and direction in which you would need to focus your attention. I have specific criteria in which I would need to be able to collect on. For candidates that apply I will give the specific details of exactly what I'm looking for.

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Need A data extraction, web scraping expert needed for ongoing data mining activities. Need to be able to use import.io and or scrapy.org for extracting data. I will give you instructions on the data I need and I need you to build a crawler/extractor that will find the information and present it in csv format I also need you to find information on latest blogs, social media mentions, etc of my topics and people and compile it into data I can use. Respond with what you can do Software you work with work you have completed time frame to start getting data

Hourly - Est. Time: 1 to 3 months, 10-30 hrs/week - Posted
The task is to implement a focused Web crawler component comprising an API and a Web-based GUI. The focused crawler's objective is to gather user-specified pieces of data from Web pages using two strategies: (1) by carrying out a set of Web search engine queries for user-provided query terms, by downloading Search Engine Result Pages, and optionally following the hyperlinks contained therein; and (2) using a set of user-provided seed URLs, by following the hyperlinks on the Web pages identified by these URLs, using a breadth-first search and a user-specified depth. Rather than implement from scratch, the project should be pursued as wrapping existing open-source components such as crawler libraries and Web search engine APIs with additional layers of functionality, and in some cases, providing a convenience layer that hides complexity. Skills/technologies: Java, Heritrix, WARC, search engine technology, crawling, Yahoo BOSS

Hourly - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We work in the software "Visual Web Ripper"; targeting a specific type of information. To import into Magento as products and imformation It will be your job to customize this template to fit each target site and to deliver your work to our import system.. It can take everything from 15 minutes to 5 hours to create a crawler (depending on the complexity of the target site). You will be paid per hour for your work We are looking for a person long term Requirements: -Expert skills in creating crawlers with Visual Web Ripper -Expert skills in .NET syntax/scripting -Available on Skype.

Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
Need a you to find companies doing plastic injection molding. I will set up a google online excell sheet that I need you to fill in with company name, web site, address, contact, email. Will also need you to follow and ad them to my facebook, twitter or linked in account Do not spam me with you complete work history, I will not read it, and I will delete it, just let me know: 1. If you can use google excell sheets. 2. Can you write and speak English to a decent level. 3. Your best hourly rate. 4. How many contacts can you input in one hour, roughly. I am on a very tight budget, so please make your bid reasonable.Please use my name when applying. Colm.

Hourly - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
Hi, I am looking for someone to perform data mining, web scraping or crawling to extract some data from the Assessment Rolls of multiple cities across Canada. The first job would include 20 cities which are located in the Province of Quebec and total around 1 900 records. See attached Excel spreadsheet for the number of sites per city plus the address for consulting the assessment roll. There are a few things you must be aware of in order to quote for this job: • Most of the websites and data are in French • Many of those sites use Captcha and some also have a set consultation maximum per IP Address; • I will supply you with a list of lot numbers for which I need the Landlord’s name and mailing address in return (1111111 format); • Some of these lots may point out to many records; in that case we need the all. • Each record should normally include these data: o Matricule # o Property address o Landlords • Names • Addresses o Assessment Roll...

Hourly - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
We're a consumer electronics startup prepping up our pre-sales campaign. We need someone to harvest emails or sell us lists for the following customer segments. - Teachers, principals at elementary, middle and secondary schools. - Emails from home-school associations - Emails from crowdfunding enthusiasts (fans, professionals, businesses, bloggers, etc.). - Incubators, accelerator programs for tech hardware, artificial intelligence and robotics Our geographical markets are: UAE, Saudi Arabia, India, Germany, UK, USA, Canada, Australia. You can sell us your existing lists.