Scrapy Framework Jobs

40 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Fixed-Price - Intermediate ($$) - Est. Budget: $350 - Posted
We're building a tool that analyzes a website's contact point. So we need : - an php interface that we can upload our urls (we would send 10.000 for example) - cvs or just a textarea - a db that stores each of these urls and some basic data about them - a scrapy bot that takes each of these urls and scrolls the website for contact point he finds (email, twitter, Facebook, LinkedIn profiles, contact form) - then the bot sends back each contact point to the db - then we can extract the websites that have contact points - cvs file PLEASE : DO NOT APPLY TO THE PROJECT IF YOU DO NOT HAVE EXTENSIVE SCRAPY EXPERIENCE - we will ask you expert questions about it.
Skills: Scrapy PHP Python
Hourly - Intermediate ($$) - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
Looking for a company with web crawling experience as an standby. The company should only intervene in worst case, all activities and processes for the worst case scenario will provided after assign contract. The company must be experience in Python, Scrapy Mongodb and Flask or Django.
Skills: Scrapy CSS Django Flask
Fixed-Price - Expert ($$$) - Est. Budget: $5 - Posted
We are looking to hire an application developer for an ecommerce website. Requirements - An application consisting of 2 modules, 1st module scrapes data from websites and the 2nd module analyses the scraped data and compares with the native data. The compared data will then be filtered to pick and display a specific variable/value. Please provide a quote if you are interested to work on this application. Regards, DUT3
Skills: Scrapy Web Crawling Data scraping Web Crawler
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
I am looking for an experienced Scrapy developer (I repeat, Scrapy, not other languages please) in order to create and adapt a Scrapy script to scrap 100+ sites, all different between each other (for every website, we will need the Scrapy code script and the scrapped site info in json). Will provide list of websites as soon as the job is assigned but they are around the size of: www.activesport.co.uk www.airevalleycycles.com www.alansbmx.com www.all4cycling.com Before awarding any applicant, we will ask to scrap www.all4cycling.com and send us: 1- scrapy code 2- scrapped indo in json.
Skills: Scrapy Python
Fixed-Price - Entry Level ($) - Est. Budget: $15 - Posted
We need to scrap business company data from a website. We need the result, not the source code of the script. You will have to provide an excel spreadsheet with these values: Business name Contact last name Contact first name Address Post code City Phone Email Website Please see attached file for more details. There are around 2000 buisness companies in the directory. If the work is done properly, we may have other data to scrap.
Skills: Scrapy Data scraping Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
Hi, I need someone proficient in web-crawling to build crawlers to scrape the company names and other information from an aggregator site. We will provide a list of zip codes and aggregator site. You will need to supply the source code / configuration of each scraper so that we can repeat (possibly with modification) jobs. Python/Selenium/Scrapy are preferred. Scraped data to be stored in Excel, but storage into a MongoDB database would be preferred.
Skills: Scrapy Python Selenium
Hourly - Intermediate ($$) - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
We're looking for a person with experience in web scraping to scape event activities from multiple websites. We prefer people with the following skillsets: (1) Python (2) Scrapy (3) Postgres DB You must be knowledge about: Different DOM Structures Mapping an entity across different webpages Rotating Agents It'll be great if you have sample code that can show all of the above. Thanks!
Skills: Scrapy Data mining Data scraping PostgreSQL Administration
Fixed-Price - Intermediate ($$) - Est. Budget: $150 - Posted
I am looking to collect contact's email, phone number, title, from a list of 4,000 small to medium sized companies in the midwest geographical area. I will provide a spreadsheet with the list of companies and I will need the names and contact details of marketing department employees per account. This information can be collected through LinkedIn, FB, website or any other medium you know of. This will involve searching for a directory and pulling the key information of people based on keywords and their title. Companies can have anywhere from 1 - 20+ of these contacts. The titles in order of importance include: VP of Marketing Director of Marketing Marketing Manager Other keywords in title or description: insights feedback survey customer experience patient experience ux survey monkey survey gizmo When you find the contact you will collect: - Name - Email - Phone Number - Title - Any links to a bio or bio itself Please provide quote for project. Thanks!
Skills: Scrapy Data mining Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $200 - Posted
I need someone proficient in web-crawling to build crawlers to scrape the company names and other information from US state company database pages and other aggregator sites. The information scraped will need to be stored into a spreadsheet template we provide. We will provide a list of US state websites and aggregator sites, but you may consult the attached schema and examples to better understand the information and format we will need. Additionally supply the source code / configuration of each scraper so that we can repeat (possibly with modification) jobs. Python/Selenium/Scrapy are preferred. Scraped data to be stored in Excel, but storage into a MongoDB database would be preferred. This is a series of one-time projects. If I am happy with your work on a single project, you can expect to receive repeat business on the other US states and aggregators. I am looking for well written python code that is maintainable and uses the most relevant python libraries.
Skills: Scrapy MongoDB Python Selenium