Web Crawler Jobs

67 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Fixed-Price - Intermediate ($$) - Est. Budget: $2,000 - Posted
We need a generic crawler, which can: 1) analyze the webpage structure of the input website 2) recognize the webpages where the target information may exist 3) parse and extract required contents in these pages using NLP&ML technologies 4) store scraped contents into their corresponding fields in MongoDB For example: We need some product information from online store, and we input the URL of one store. The crawler will visit different links in the website and make statistics. He found that some webpages have the similar structure, and this structure has a high repeat rate. Then the crawler will think that this kind of webpages may contain the product information, and will check the contents in it. He will parse the contents, and when he has recognized the contents which we need like Product Name, Product Type, Price, Production Description, he will extract them and store them to the corresponding fields in MongoDB. To make this crawler, the following skills are required: • Crawler skills • MongoDB skills • Machine learning • Natural Language processing We prefer to use Java as programming language. Python is acceptable. We will reveal more when contacting with you.
Skills: Web Crawler Java Machine learning MongoDB
Hourly - Entry Level ($) - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We are looking for solutions to scrape all jobs in Biotech. We like to scrape the websites of biotech companies (we can povide the urls) It would even be better if we could crawl to find companies that are Biotech. So that we don't need the urls to be provided. The data should be structured, so that we can upload it onto our platform. The job should be redone on a daily or weekly basis. Who can write us the code?
Skills: Web Crawler Web Crawling Data scraping PHP
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
I need someone to build a Excel vba based web crawler to extract large amounts of data from websites. Someone that has work experience of more than 3 years creating web crawlers/ scripts to extract data big websites and solve any security issues. .
Skills: Web Crawler Data mining Data Science Data scraping
Hourly - Expert ($$$) - Est. Time: 1 to 3 months, 10-30 hrs/week - Posted
We are looking at Extracting data off web . This will include extraction and submitting it to an excel database
Skills: Web Crawler
Fixed-Price - Intermediate ($$) - Est. Budget: $5,000 - Posted
The job requires creativity and analytical thinking to solve problems and move the growth metrics for the project. Skills Required 1. Web Crawling 2. Scripting: Javascript/Ruby/Python 3. File I/O: Reading and writing to CSV files. Mentorship will be provided if needed. Fixed pay for the task however I am flexible and can pay hourly once we establish a rapport.
Skills: Web Crawler Web scraping
Fixed-Price - Expert ($$$) - Est. Budget: $200 - Posted
I would like a prototype of a script/site that allows you to enter checkin and out date and a star rating and search for hotels for priceline express. (http://www.priceline.com/hotelxd/listDeals.do?jsk=364a050a354a050a201608312335316d8010241336&hdsk=isjjlvyy&itinKey=1dm4uwo.itdt8cg0.itf8o740.1#pn=1;sort=0;amen=;area=;price=;star=3:3.5:4:4.5) Now the script/site must show the lowest price of one hotel for every star rating. So if a 3 star hotel had 2 hotels, and a 3.5 star hotel had 4 hotels, it would show the lowest price hotel of each. Once this is accomplished I want an automatic way to show https://www.priceline.com/hotels/startOffer.do and do the steps on the site. So it takes information from priceline express, shows some user data based on location and then auto fills out information on the Name Your Own Price tool on priceline. Please contact me to discuss the prototype more.
Skills: Web Crawler JavaScript PHP Ruby
Hourly - Intermediate ($$) - Est. Time: 1 to 3 months, 10-30 hrs/week - Posted
Looking for ruby / python developer who has experience building SERP crawlers and knows all ins and outs of it. For start we would need to create a really simple MVP / prototype, which would be gradually improved in the future iterations. Please respond and state your experience in building SERP crawlers. Be specific and explain how you plan to make crawler less noticeable by search engines (this reduces the risk of IP blocking, CAPTCHAs and other stuff). Big plus if you are Russian speaking. We have the specs ready. You application would be discarded if you don't have relevant crawler building experience or you don't have specified technical background.
Skills: Web Crawler Web Crawling Python Ruby