Scrapy Framework Jobs

34 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Hourly - Expert ($$$) - Est. Time: More than 6 months, Less than 10 hrs/week - Posted
Are you the go-to Scrapy scraper? Are you able to scrape a large amount of information and images? If so, you're the ONE we're looking for! We're in need of an experienced scraper, that has the abilities to scrape a large amount of informations and images, and get them in our database. In fact, we already have a scraper, build via Scrapy. So knowing and loving the Scrapy tool is a must! I'd love to share some details on the job with you upon request. Looking forward to hear from you!
Skills: Scrapy
Hourly - Intermediate ($$) - Est. Time: 3 to 6 months, 10-30 hrs/week - Posted
Looking for a person to help us add more crawlers to an existing set of web scraping spiders, currently running on Scrapinghub's Scrapy Cloud. The pending list is currently around a dozen, but in the medium to long-term could turn into hundreds of sites. Bonus points for: - Experience writing Scrapy pipelines and middleware. - Experience with NLTK, Scikit-learn or cloud-based Machine Learning platforms. - Knowledge of scrapyd and/or Scrapinghub's platform and API.
Skills: Scrapy Python Web scraping
Fixed-Price - Expert ($$$) - Est. Budget: $400 - Posted
We are looking for an expert Python developer, with experience of the Scrapy web crawler. You will be asked to custom configure Scrapy to extract specific DOM elements from a page, abide certain crawl conditions, use the Splash headless browser and manage crawl tasks via an Amazon SQS queue. Experience with PhantomJS and BeautifulSoup also an advantage.
Skills: Scrapy Amazon Web Services Python
Fixed-Price - Entry Level ($) - Est. Budget: $15 - Posted
We need someone to develop or generate large batches of EAN numbers, EAN has 13 unique numbers, UPC or BAR CODES in spreadsheet. Each number must be different and never used in past. Also we need someone with experience in Adding Products From Excel To Shopify or EKM or InstantEstore. In addition we need someone to extract large amounts of data from websites whereby the data is extracted and saved to a local file in your computer or to a database in table (spreadsheet) format. Freelancer must be honest, reliable and good communication in English. Freelancer must be hard worker, dedicated, efficient, reliable, energetic, professional & motivated to succeed. We someone who market our websites and get fast results via Facebook, Pinterest, Twitter and Instagram,etc. Fees are negotiable.
  • Number of freelancers needed: 80
Skills: Scrapy Amazon Appstore Amazon EC2 Amazon MWS
Fixed Price Budget - Entry Level ($) - $150 to $300 - Posted
Looking for some with experience in developing web crawlers / scrapers. Ideal candidate will have experience building crawlers in C#, PHP, etc. Require to build a Crawling tool that will be used on ad hoc basis. Need candidate to start immediately. Company has a tight budget and as a result only looking for serious candidates who want to work long-term. Candidate will be paid on a per site basis. If per site crawling fee is over $30 need not apply.
Skills: Scrapy C# Web Crawling Data scraping
Hourly - Expert ($$$) - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
I need an expert scraper with proven experience that can build us a simple user friendly app that will allow us to crawl code to the urls that we provide and search for a line of code. If the code is unavailable, it will return the results of the urls. This is a very simple app. If you are qualified to create this please respond with "scraper".
  • Number of freelancers needed: 2
Skills: Scrapy Data scraping JavaScript PHP
Hourly - Entry Level ($) - Est. Time: Less than 1 month, 10-30 hrs/week - Posted
I'm looking for an experienced programmer to build a tool to regularly (every 30 days) import data from between 50 and 100 websites into a relational database that we can use to analyze the data from. You will build scrapers using your choice of technology (Python, Ruby, PHP), and then store the data into a MySQL database server that will be setup on the server where you will have access to develop and run the scrapers from (Linux server running CentOS 7.1 64-bit). The selected developer will be given access to a Github.com or Bitbucket repository where code can be committed to by yourself as well as by other members of my in-house software development team. All of the websites to be scraped are quite standard e-Commerce websites with a couple websites being informational websites.
Skills: Scrapy CSS Data scraping Django
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
Essentially, what we want is a tool that will search the internet for keywords that is specified and then post those findings into our site's forum. Third party technology can be used to scan and scrape the internet but must be mentioned in and costed in your solution and cost. Another option is to manually specify a variety of URLs and the tool will just scrape new posts from that URL and post into the forum with associated tags. Our site is a wordpress site using bbpress for forums. We know how we want it to work - we just dont know how it will work so we would want you to come up with that proposal.
Skills: Scrapy Web scraping