You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Web Crawler Jobs

44 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only

Fixed-Price - Est. Budget: $ 60 Posted
Find 150 facebook groups contact information that would have a large amount of single men in them Criteria for Facebook groups: - Have to have at least 2,000 members. The higher the better. - Have to be able to contact the admins. The admins personal Facebook page cannot be private to where I can not contact them. I have to have at least 1 admin that I can contact for each group. - The group's topic should be about or related to dating, singles, or admiration for a specific type of woman's race, body type etc. for example: men who love Russian women, curvy women and the men who love them, Professional singles in America. Here is an example of one of those groups: https://www.facebook.com/groups/BlackWomenAreSexy/ Just find groups that have a large concentrations of men where the groups are about the topic of dating, sex, attraction to a certain type of woman. You can offer suggestions of other types of groups that may have a large concentration of single men. -...

Hourly - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
I'm looking for someone to write a scrapy crawler for getting open proxy IPs and saving them to a text file. An example page I need scraped is http://www.idcloak.com/proxylist/free-proxy-ip-list.html, and the output format will be a text file with one IP:Port per line. This project will start with scraping 1 site, and then expand to at least 5 sites.

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
We are looking for someone to source products for our Amazon business for private labeling through approaches such as purchasing direct from a supplier like (Alibaba). The categories we are interested in are as follows: Health & Beauty, Travel, Home, Tools & Home Improvement, Automotive or Patio, Lawn & Garden. We would like someone that is proficient in at least one or two of these categories. Meaning you are very familiar with and have done searching in these categories extensively. We are most interested in your experience in dealing with Alibaba. Specifically, we are looking to source a product that we can make our own i.e. (private labeling ). When you find a product we ask that you check the top 3 in sales ranks, number of reviews, average selling price, weight of product, then once we decide on a product we will have you talk to Alibaba suppliers (Gold & Preferred and on onsite verified) and get the cost of some samples and shipping price for samples. Also, tiered pricing...

Fixed-Price - Est. Budget: $ 50 Posted
If you feel that the budget is to low then bid what you would charge. Find 20 dating blogs/bloggers and 30 dating sites contact information that would have a large amount of single men in them. I am targeting these groups, blogs and sites because I want to promote a dating ecourse for men to meet women. So keep that in mind when finding groups. blogs and dating sites Criteria for dating sites and dating blogs: - Have to be targeting either men. Or men and women, but not just women. - Has to have a combined total of 2,000 – 10,000 likes and followers between FB, twitter and Instagram - They must not be selling a dating course for men. - They must be in the USA, Europe or Canada. - Contact information that I must have: 1. Person's Name 2. Name of site 3. Company's or bloggers mailing address 4. Emails and/or contact page. The more email addresses the better, Most of the companies have generic email's so your duty to not just collect those but also to collect direct...

Fixed-Price - Est. Budget: $ 200 Posted
We are seeking a perfectionist to scrape 100,000 + records from the MLS that will be broken down in different towns, cities, and areas of Illinois, Wisconsin, Indiana, etc. The information will be in a spreadsheet format that has Listing agent and Buyer Agent Contact information which will include Name, Office/Phone number, Cell number, email, fax, etc. I want different tabs for each area with information on properties closed and the buying and seller realtors contact info. I also want a tab with all areas and realtors under one tab. I also want a cell that tells me how many duplicates there are for any real estate agent. Here is a copy of a video I created to show the process http://screencast-o-matic.com/watch/coi0QAfUxe.

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Hello, I'm seeking an experienced data mining professional, who can compile specific data lists that will be converted to leads for a call center business. I would be able to provide the insight and direction in which you would need to focus your attention. I have specific criteria in which I would need to be able to collect on. For candidates that apply I will give the specific details of exactly what I'm looking for.

Fixed-Price - Est. Budget: $ 300 Posted
Hi, Pretty simple scraping project but the output needs to be an application that I can install and run myself (or that runs in a hosted environment). The application itself will: a) authenticate with LinkedIn as a user inputs for this step: username, password, verification code (may be required if running as a web app) b) visit a specific user's profile input for the step: target profile URL c) scrape all the 1st degree connections for that user (this requires paginating through the contacts...) outputs for this step (output as csv for all contacts for the target): Name LinkedIn profile URL Company Current Role Company URL (if available) Work history Requirements: - this can run as a web app OR as a desktop app (I'm open to either) - if creating a desktop app, it needs to run on OSX Yosemite or higher - if creating a web app, you'll need to set up the server environment and provide a secured web interface for inputting the parameters

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Need A data extraction, web scraping expert needed for ongoing data mining activities. Need to be able to use import.io and or scrapy.org for extracting data. I will give you instructions on the data I need and I need you to build a crawler/extractor that will find the information and present it in csv format I also need you to find information on latest blogs, social media mentions, etc of my topics and people and compile it into data I can use. Respond with what you can do Software you work with work you have completed time frame to start getting data