You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Scrapy Framework Jobs

22 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only

Fixed-Price - Est. Budget: $ 10 Posted
need someone to fix a python script made of scrapy framework with 2 function of scraping all the information from viralnova.com and the other function is posting this info to protatype.com. the script was working well but it somehow broke down

Fixed-Price - Est. Budget: $ 500 Posted
I need 50 directory scrapping scripts built in Scrapy and python in the next 30-45 days. You would need to begin work relatively soon. GUI and current interface for 110 scrappers currently exists. You would be taking on an existing project and adding 50 scrappers. Sometimes you will be fixing existing scrappers. Scrappers are hosted on my server and everything would be run from an online GUI. Please apply only if you have extensive Scrapy experience and python knowledge. If I like your application, I will send you a video with full details of this project.

Hourly - Est. Time: More than 6 months, Less than 10 hrs/week - Posted
We are seeking python developers to code spiders for crawling e-commerce websites. See attached document for the details on the work. There will be a test job with a payment of 25 USD (15 USD for partial but acceptable functionality). Example code will also be provided. Our usual payment is for each spider, but you can bill it hourly on oDesk.

Fixed-Price - Est. Budget: $ 80 Posted
I need to scrape newly added business listings from www.gumtree.com.au on a daily basis. The daily data must be provided to me in a CSV/Excel file. Data must be unique and must have phone numbers. Please go through the attachment of sample output structure. The job has a potential to go on for several years provided quality and consistency is maintained. Note: Apply only if you have done this previously and have a credible solution to overcome the obvious challenges of blocking as well as AU IP restrictions. if you wish to be considered, I would suggest trying out for a 2-3 days by giving me daily sample records. This will give me idea of your capability. Who ever bids $80 or below will be hired immediately This is a long term job and if succeeded and if cost is reasonable it will go on for years. Regards, Wantro

Fixed-Price - Est. Budget: $ 150 Posted
Scrapy data collection for 5 sites 1 JSON file as output per website Www.bigw.com.au Www.kogan.ccom/au Www.Myer.com Www.target.com.au Www.oo.com.au Items to collect products Product URL Price Product image URL Product desc Sku Category dESC Product sizes Sale Price Normal Price

Hourly - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
I require data extraction of real estate websites (Trulia, Zillow, for example). Websites are already selected, so the sources for the information to be extracted is not something you have to waste time on searching. The most important requirement is that you have a lot of experience developing scrapers with Scrapy, that you have attention to detail (we don't want to waste time with small mistakes) and that you consider yourself fast at programming your code. We will start with one website to see your work. But the idea is to extract data from a few other real estate sites. Please indicate your price and time of delivery for this one website. Additional details: - The maximun amount of data that have been extracted is 20 thousand in one website. Others have way less. - There are websites with a lot of javascript, so experience with these kind of "javascript-instensive" websites is required. Aside from the price, let me know your past experience with scrapers (github...

Fixed-Price - Est. Budget: $ 40 Posted
We need someone who can scrape a website for us and provide the script for it. Candidate MUST: - have great English communication skills - deliver within 3 days - provide clean code / clean and meaningful mysql database or .csv - use http://scrapy.org/ or similar tool or convince us there is a better method to scrape You will: - Scrape one or more sites for us and provide all the data and automated script to duplicate the work. - Script must work under any and all conditions and should take care of delays, IP suspensions, etc... - comment your script properly and create very clean code - assign meaningful variable names

Hourly - Est. Time: 1 to 3 months, Less than 10 hrs/week - Posted
I want someone to build a web scraper with python and scrapy and document the entire process. I am new to programming and want to be explained how its done. I will pay fixed price or hourly. Please message me for the website I want scraped. There will be a csv input file, and export should also be csv.