You've landed at the right place. oDesk is now Upwork. Learn about the new platform.

Scrapy Framework Jobs

19 were found based on your criteria {{ paging.total | number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("hourly") | number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("fixed") | number:0}})
show all
only
only
only
show all
only
only
only
only
only
show all
only
only
only
Hourly - Entry Level ($) - Est. Time: More than 6 months, 30+ hrs/week - Posted
We are looking for a long term web scrapper who will work with us 40 hours a week. Its a full time long term job. Please don't apply if you are already working. We will hire 2 candidates for this job Project start data is February 2nd. Thanks Team Oracle Staffing Consultancy
Skills: Scrapy Python Web scraping
Hourly - Intermediate ($$) - Est. Time: Less than 1 week, Less than 10 hrs/week - Posted
We're looking for someone to help us scrape activities/events data from various websites. You must use Python and the Scrapy framework to do this. The scrapped data will be saved in a postgres database so it'll be a plus if you are familiar with postgres. Please include in your proposal/cover letter: Any code examples (github repo would be perfect). If you have examples of previous scraping code that'll be great. It'll be even better if you have examples of how you mapped the information scrapped to a database model. If your work is satisfactory, we will continue to work with you on a regular basis. Thanks for applying!
Skills: Scrapy Data mining Data scraping PostgreSQL Administration
Hourly - Entry Level ($) - Est. Time: 3 to 6 months, 30+ hrs/week - Posted
Livebook Labs Inc., is looking for an expert in Scrapy of similar tool to develop a machine learning and text analytics system.
Skills: Scrapy
Fixed-Price - Intermediate ($$) - Est. Budget: $150 - Posted
I need a spider or web scraper that can be launched via "terminal" using MAC El Captain. the spider should scrap each school in Australia and write the results to a xlsm file in a similar layout to the attached file. The link to the website is here --> https://www.myschool.edu.au/SchoolProfile/Index/89771/OsbornePrimarySchool/48479/2014 https://www.myschool.edu.au/ResultsInNumbers/Index/89771/OsbornePrimarySchool/48479/2014 In the future this data will likely be implemented into a meteor web app and stored in mongo db so any development that ensures the data is suitable for uploading into a NOSQL. Please be aware that this site does have CAPTCA from time to time. I am happy for the spider to request a manual capture value to be entered from the user (Me) as this scrapper may only be run every 4 - 6 months.
Skills: Scrapy Data scraping JavaScript Python
Fixed-Price - Intermediate ($$) - Est. Budget: $600 - Posted
**Please do NOT send me a "generic" offer without telling me in detail how you would implement this project - i.e., which program language, Python, WP plugin software, etc. JOB: I am looking to model/copy a competitors software and website. I am interesting is copying BOTH a) the website, and b) the software (as SAAS) Competitor website: http://sales2.pushbuttonautomarketer.com/ I encourage you to watch the video on the website to get a better sense of the software. ********IF you are only interested in doing the scraping software. Fine. Just let me know. I can do the web-design elsewhere. The website is the easier part. WEBSITE: This website offers SAAS (software as service). Website would need to be a paid membership site, with customer login, links to payment processor etc. SOFTWARE: Here is my understanding of the software. The goal of the software is to generate real estate sales leads. It does this by searching real estates sites (primarily Craiglist) and scraping data from sellers and then sending them an email. It needs to: a) scrape phone, email, and other data from selected sites b) send an email to seller (although this software also phone auto-dials – not sure how that works, maybe Twilio). c) Reads and categorizes seller email responses as "yes/no/maybe". My first thoughts/suggestions on implementation: 1. Website in Python using the Flask framework [ Frontend, Backend, Recurring Billing, etc] 2. Scraper using the Scrapy.org framework which will run automatically in the background as required. I am open to other suggestions/ideas.
Skills: Scrapy Twilio API
Fixed-Price - Entry Level ($) - Est. Budget: $100 - Posted
I need a freelancer who has experience using Import.io for building Extractor and Connector APIs. I have built a core database with 50 APIs myself and need support to expand this initially up to 100 more APIs (depending on quotes), this would be again expanded later to eventually 1000's for the right Freelancer, hence a potential long term partnership if the work is top quality, and on time!! The Connectors are fairly straightforward requiring name and product page links at a minimum, which can be linked to an Extractor pulling images, currency and text (typically min 5- max 10 data points per page). Therefore, please respond with your price per 1 x Connector & Extractor API, my budget is very limited so be generous, this can be improved in later repeat arrangements... Remember, Quality is absolutely imperative!!
Skills: Scrapy Data scraping Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $250 - Posted
Are you a Web site scraping expert? Then I want to talk. Currently developing an application that relies on grabbing data from other sources. Here are the specifics: 1. Scrape 5-8 sites on an ongoing basis. 2. We only need to scrape specific pages, so it won't be entire sites. 3. Scraped data will be uploaded via CSV or similar file. 4. We will need a way to manually upload new URLs to be scraped. So, imagine a service where each new customer would mean adding 5 new URLs to spider on a regular basis. The content we'll be spidering will be the backbone of this new solution. I'm relatively new to site scraping, so there may be some hand-holding and more explanation than usual. However, I am pretty versed in technology as a whole and have developed apps in the past with software engineers. Ideally, we'd like to pay for this once, uploading new URLs to spider ourselves, but we recognized this may not be easy. If we have to work with an expert on an ongoing basis for awhile, that's OK. Interested? Let's talk.
Skills: Scrapy Data scraping Web scraping
Looking for the Team App?
Download the New Upwork Team App
Fixed Price Budget - ${{ job.amount.amount | number:0 }} to ${{ job.maxAmount.amount | number:0 }} Fixed-Price - Est. Budget: ${{ job.amount.amount | number:0 }} Open to Suggestion Hourly - Est. Time: {{ [job.duration, job.engagement].join(', ') }} - Posted
Skills: {{ skill.prettyName }}
Looking for the Team App?
Download the New Upwork Team App