Web Crawling Jobs

63 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I need someone to build a Excel vba based web crawler to extract large amounts of data from websites. Someone that has work experience of more than 3 years creating web crawlers/ scripts to extract data big websites and solve any security issues. Please see attached file for format needed. Site aliexpress . com ioffer . com etc.
Skills: Web Crawler Data mining Data Science Data scraping
Hourly - Intermediate ($$) - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
We're looking for an expert who used the crawling software 'Crawl Anywhere 4' thoroughly in the past. More specifically a deep understanding of the inner workings and transport of data in said system is required. Some key information: - The system holds 500+ sources that need to be crawled constantly - Deployed on Ubuntu 16.04 Requirements: - Deep understanding of Crawl Anywhere (Crawler, Pipeline, Indexer scripts) and its possible configurations - Experience in using Solr. - Confident in working with Ubuntu (16.04) OS. - Finding performance bottle necks and possible solutions (both OS and Crawl Anywhere). - Confident with SSH
Skills: Web Crawler Apache Solr Web Crawling Laravel Framework
Hourly - Intermediate ($$) - Est. Time: More than 6 months, Less than 10 hrs/week - Posted
Hello - I'm looking to work with a researcher/job recruiter who can help me find work-remote jobs within the field of media. I'm a media producer - specializing in web content, editing for text, video and graphics, news items and more. This is a two-part job: 1) Research and collect job postings for work remote or work from home jobs within this field. Work from home ONLY 2) Help me submit my cover letter and resume to each job by tailoring my resume and cover letter to each specific job before we submit them. You will be paid for each round for items 1 and 2 as we go. Please send description of how you will approach this job and why you feel you are the qualified candidate. MUST BE: Skilled in doing deep web research and finding these specific types of jobs only. No on-site jobs. It must be 100% work remote. Add the word "REMOTE" at the top of your response so that I know you are not spamming Thanks!
Skills: Web Crawler Human Resource Information Systems Human Resource Management Internet research
Fixed-Price - Entry Level ($) - Est. Budget: $999,999 - Posted
For a new business oportunity i am looking for someone who can set up an crawler that automaticly search for jobs in the Netherlands using a couple of parameters (location,job title etc). The crawler must search in multiple websites. Do you have a better idea please contact me so we can discuse it.
Skills: Web Crawler Web Crawling
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I used to subscribe to Rainking.com and was able to download its complete list of IT decision makers fairly easily up to a maximum number of records at a time. I suspect with a web crawler, it can be downloaded more quickly. If you have access to the Rainking.com and/or discover.org database, I would need all available fields including first name, last name, address, city, state, zip, country for data outside of the USA, phone #, fax # if available, any category fields, and most importantly email address at the individual name level. I also would be interested in the same type of data from discover.org and anything else similar where the focus are IT executives around the world. I'd like the data in CSV format. Please let me know what is world cost and how quickly I could get the file. Budget shown is a placeholder.
Skills: Web Crawler Web Crawling Data Entry Data mining
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I am interested in a list of people involved in commercial real estate in the NJ (New Jersey) USA counties on the attachment from costar.com or a similar service: Bergen, Passaic, (excluding West Milford and Ringwood), Morris, Hudson, Essex, Union, and Middlesex. The towns with their zipcodes are shown below. You would need to have access to Costar.com or a similar service. I would like all available fields separately such as first name, last name, job title, address, city, state, zipcode, phone number, fax number, email address for the individual (e.g. as little as generic emails such as info@vornado.com as possible) and type of company such as Brokers and Brokerage Firms. I would like the data on individuals under Brokers and Brokerage Firms, Owners and Investors, Multifamily Owners and Property Managers, and Retailers and Corporations. Please let me know what source/s you will be using for this data and a cost per thousand records provided or the complete job if you can bring in all the data from Costar. Please dedupe if needed so we don't see the same individual contact names multiple times. Please provide final file in XLS or CSV format. I'd also like the time needed to complete the project. Pricing shown is just a placeholder.
Skills: Web Crawler Web Crawling Data Entry Data mining
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I will be providing you with a list of perhaps 5,000 or 10,000 New Jersey USA realtors in the format on the attachment. I will need for you to research and add to the Excel document I provide accurate email addresses found from sources such as LinkedIn profile and company website, and to a lesser extent from less accurate sources such as data.com, possibly Hoovers if you have, and Zoominfo. You should be able to find the email addresses googling around as well. I envision part of this task may be automated via a web crawler whereby you pull in email addresses from various sources and then you verify if there are matches with different email addresses for the same person at the same company. I'd like your cost per thousand email addresses added to the estimated 5,000 or 10,000 records and time needed to complete this project. Budget provided is just a placeholder.
Skills: Web Crawler Web Crawling Data Entry Data mining