You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Scrapy Framework Jobs

22 were found based on your criteria

show all
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only

Hourly - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
Hi We need someone able to build a script to programmatically help us use our linkedin with bing, to improve profile management. More details of the required script to the successful candidates. Successful candidates MUST have very good knowledge of Scrapy, and previous experience using it with Bing and Linkedin. Regards
Skills: Scrapy

Hourly - Est. Time: Less than 1 month, 30+ hrs/week - Posted
Web front end required to allow employees to search pubs/restaurants/bars in a specified location. Front end should provide a text field to search in a specified location, using autocomplete and google place api's to ensure valid input. Scrapy required to search applicable sites for restaurants/bars/pubs within approximate 10km radius of the specified location. Results to be displayed on a search results page with Restaurant/Bar name, address, website where available, phone number, review/star rating and number of reviews. Results will be sorted first by star rating and second by amount of reviews received and grouped by review website which information is scraped from. Scrapy is preferred but other API's will be considered (Selenium etc). Reply should include rough estimation of time required to complete. Follow on work possible for updating website to allow user to filter based on star rating and distance from specified location.

Fixed-Price - Est. Budget: $ 25 Posted
I need to program a cron job in python. http://www.avis.com/car-rental/avisHome/home.ac Giving 5 initial variables (dates and time for pick-up and return, and pick-up location), and leaving all the other default values in the form, I neet to retrieve a list with all available rental cars (category, model, price 'pay now, and price 'pay later')

Hourly - Est. Time: 3 to 6 months, Less than 10 hrs/week - Posted
Need A data extraction, web scraping expert needed for ongoing data mining activities. Need to be able to use import.io and or scrapy.org for extracting data. I will give you instructions on the data I need and I need you to build a crawler/extractor that will find the information and present it in csv format I also need you to find information on latest blogs, social media mentions, etc of my topics and people and compile it into data I can use. Respond with what you can do Software you work with work you have completed time frame to start getting data

Fixed-Price - Est. Budget: $ 300 Posted
### Expert Level ### Please reply with real world examples ?? If you have experience with a bloom filter please let me know. Hi I have a version of the application already built but isn't performing as I had hoped. I need a developer to help me improve the application in terms of performance and accuracy. Below are what I want to happen so be clear in your replies that you can perform this type of work. - Web scraping sort of works, but really needs to become multi-threaded and a lot more robust (currently breaks lots), the basic stack is below but I'm not adverse to other technologies being used. - The crawler aims to collect 100's millions of rows of data from numerous content networks, so the crawler needs to be able to manage that number of rows and the complications that bring to the table. - Post content to social networks, current app doesn't post in the correct format (weird categories) so that needs to be fixed. Basic headlines - Create multi-threaded...

Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
I have the scrappy framework that has been installed. I'm looking for an expert in scrapy spider configuration to mine multiple sources.

Hourly - Est. Time: Less than 1 week, 10-30 hrs/week - Posted
We need an experienced Scrapy developer to help fix some bugs, and buildout small features for an existing project. We have an existing pipeline and need to clean up some data before getting saved to mysql db. We would also like to scrap some extra fields as well.

Hourly - Est. Time: Less than 1 month, Less than 10 hrs/week - Posted
Overview I put a brief up a few weeks ago, but due to the requirements significantly evolving – have had to rewrite and repost this. To give a bit of background on my client – they have a number of e-commerce websites and the markets they work in are highly competitive. As such, they need to ensure their pricing is always as competitive as possible. Their current process involves manually reviewing their competitors by browsing Google Shopping on an ad-hoc basis, searching each of their products one by one. Any products sold cheaper by a competitor is noted down and changed on their own website. It is a very slow and rather unsustainable process, considering they want to grow the business. To support their goal of always wanting to have the most competitive pricing they need to automate the way in which they obtain this information. Requirements: Whilst the client has a number of websites that they eventually will want the tool to support, for the requirements...