Crawlers Jobs

73 were found based on your criteria {{|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I am looking for someone to build a web scraper that can go to 1), 2) and 3) and search each site for a UPC number. If the product is found on the site, the scraper will capture: 1) Product Name 2) Product Description 3) Product Image (or link to image) 4) Product Price and 5) Product Weight (if available). The output should be in Microsoft Excel. We will run this scraper multiple times a week for hundreds of products. I know this scraper isn't too difficult as I've built a test one on my own but would like someone experienced to bring all three website pulls together. I am open to suggestions on the build to achieve the same desired results to pull product data by UPC if you have recommendations.
Skills: Web Crawler Web scraping
Hourly - Entry Level ($) - Est. Time: 1 to 3 months, 30+ hrs/week - Posted
I'm looking for a freelancer able to build a complex bot for ticketspinning, mail creating, account creating. More details in private
Skills: Web Crawling Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I need someone to build a Excel vba based web crawler to extract large amounts of data from websites. ... Someone that has work experience of more than 3 years creating web crawlers/ scripts to extract data big websites and solve any security issues.
Skills: Web Crawler Data mining Data Science Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
Business Problem - We need to know what city, county, state authorities are saying on parts of their websites and don’t want to go out and check them one by one - Well, that would be annoying. The Good: - We don’t need to crawl the whole web, we need to crawl very specific sites - We need to monitor for updates they make to the page (Web Change) - We need to pull in posts/articles that are matching specific words (think Boolean including proximity search, “, Parenthesis ) The Bad: - Some of the files will be PDF’s - Some of the website structures can be convoluted Example Site: 1. 2. 3. 4. 5. 6. 7. The Requirement: 1. Provide an Admin Interface where we can: 1. Put in boolean logic that allows us to search for a set of terms like “Project Approved” OR ((“KB Homes” OR “ KB Urban” NEAR “Proposal Submitted”) AND (Dallas OR Frisco OR Arlington”)) 2. Put in a set of URL’s where only those are searched 3. Label the type of Crawl that it is Company, City, Event, … 2. Label the crawling logic so we can have a simple name for the crawl job 3. Store the information retrieved into a db for us to access later for various purposes We would like the data stored into a relational database. If you can also help set up the appropriate deployment on AWS, that would be super.
Skills: Web Crawling
Hourly - Intermediate ($$) - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Some key information: - The system holds 500+ sources that need to be crawled constantly - Deployed on Ubuntu 16.04 Requirements: - Deep understanding of Crawl Anywhere (Crawler, Pipeline, Indexer scripts) and its possible configurations - Experience in using Solr. - Confident in working with Ubuntu (16.04) OS. - Finding performance bottle necks and possible solutions (both OS and Crawl Anywhere). - Confident with SSH
Skills: Web Crawling Apache Solr Laravel Framework PHP
Hourly - Intermediate ($$) - Est. Time: More than 6 months, Less than 10 hrs/week - Posted
Hello - I'm looking to work with a researcher/job recruiter who can help me find work-remote jobs within the field of media. I'm a media producer - specializing in web content, editing for text, video and graphics, news items and more. This is a two-part job: 1) Research and collect job postings for work remote or work from home jobs within this field. Work from home ONLY 2) Help me submit my cover letter and resume to each job by tailoring my resume and cover letter to each specific job before we submit them. You will be paid for each round for items 1 and 2 as we go. Please send description of how you will approach this job and why you feel you are the qualified candidate. MUST BE: Skilled in doing deep web research and finding these specific types of jobs only. No on-site jobs. It must be 100% work remote. Add the word "REMOTE" at the top of your response so that I know you are not spamming Thanks!
Skills: Web Crawler Human Resource Information Systems Human Resource Management Internet research
Fixed-Price - Entry Level ($) - Est. Budget: $999,999 - Posted
For a new business oportunity i am looking for someone who can set up an crawler that automaticly search for jobs in the Netherlands using a couple of parameters (location,job title etc). ... For a new business oportunity i am looking for someone who can set up an crawler that automaticly search for jobs in the Netherlands using a couple of parameters (location,job title etc). The crawler must search in multiple websites. Do you have a better idea please contact me so we can discuse it.
Skills: Web Crawling Web Crawler