Scrapy Framework Jobs

20 were found based on your criteria {{ paging.total|number:0 }} were found based on your criteria

show all
  • Hourly ({{ jobTypeController.getFacetCount("0")|number:0}})
  • Fixed Price ({{ jobTypeController.getFacetCount("1")|number:0}})
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
I am looking for expert , experience python scraper developer with tons of experience in scraping .. You will be creating script to scrap millions of data , on regular basis .. this will be web based script .. data will be saved in some kind of db ... Previous experience with amazon , walmart, costco, ebay etc scraping is big plus. I am not looking for command line or desktop based program. This will be web based program that run on linux AWS or some cloud server. You should know following advanced techniques to solve scraping issues 1. Able to run multiple scrap / threads in parallel 2. ABle solve ip blocking issue by proxy IP rotation logic 3. Capcha solver 4. Selenium browser automation to login to certain account and do some steps Here are some idea 1. Logic to accept scraping / browser automation request 2. decode request into scraping / browser request 3. Queue / fifo in case of too many scraping request 4. ip proxy handling logic for scraping request 4. automatically trigger some scraping on daily / timely basis 5. check scraping status, % complete , estimate , check output response/ 6. accept request only from cetrain ip .. and ip based request limit 7. Creating API for accepting request and getting data On average I am looking to pay $50 per scrap / automation website script. And we have 50+ websites that needs to be scraped. Commitment to deadline and good communication is must . If you are working on too many other projects, dont apply. This job is for 10 different amazon page scrap / browser automation scripts. 1. write 'warriors' before application 2. write your previous scraping experience. What websites and how much data. Any experience with amazon, walmart ? 3. Have you ever has issue with ip blocking ? how did you handle it ? If you used proxy rotation, from which website did you get proxies. 4. Any experience with selenium or browser automation ? 5. Send me example of previous / complex scrap / browser automation projects.
Skills: Scrapy API Development API Documentation Web Crawling
Fixed-Price - Expert ($$$) - Est. Budget: $10 - Posted
We need an expert researching web urls, to find the official web of a list of company and personal names for an web industry directory. We will provide 10k names and or keyword per day. If results are satisfactory it'll be a daily collaboration for long term.
Skills: Scrapy Data scraping Internet research Link Building
Fixed-Price - Expert ($$$) - Est. Budget: $10 - Posted
We need an expert researching web urls, to find the official web of a list of company and personal names for an web industry directory. We will provide 10k names and or keyword per day. If results are satisfactory it'll be a daily collaboration for long term.
Skills: Scrapy Data scraping Internet research Link Building
Fixed-Price - Intermediate ($$) - Est. Budget: $100 - Posted
Looking for an experienced Python developer with a good background in Scrapy to create an online course. He/She must be experienced in creating video tutorials on technical topics; links to previous relevant videos he/she created before must be provided. Work Length: ≈ 1 hour, split into several videos, 5-10 mins each. Copyrights: All rights are granted to us, including publishing and/or selling rights. Output: Both MP4 and source files must be delivered.
Skills: Scrapy Camtasia Python Video production
Fixed-Price - Entry Level ($) - Est. Budget: $50 - Posted
Looking for someone to extract the information of an event's website. The information is the contact details of the 719 companies exhibiting in the trade show (Name of the company, description, categories, website, email, phone, physical address). We'd like to have all this information put together in an Excel SpreadSheet.
Skills: Scrapy Data scraping Web Crawler Web scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $50 - Posted
I am looking to gather information about hotels in Amsterdam. On the website booking.com, currently 390 hotels are listed. Start your job on this URL http://www.booking.com/reviews/nl/city/amsterdam.en-gb.html Please see the attached documents for instructions and an example of the files required. Please indicate the number of days it will take to deliver the end result and your best price. List your preferred language of scraping (Python, C#, Java, Perl, etc.); no preference on my side. If you have ay questions, or the attached documents are ambiguous, please ask.
Skills: Scrapy C# Web Crawling Data scraping
Fixed-Price - Intermediate ($$) - Est. Budget: $15 - Posted
I need a couple of people with experience in adding products to shopify, edit images by removing logos from images. I can not train anyone you must have experience. I will hire you today if you can get this job done today. Please do not apply for this job if you do ot understand the job we need done. We do not want to waste your time or ours. Also please tell us your fixed fee for the work. Also scrappers who have experience in extracting large amounts of data from suppliers website such as product titles, descriptions, sku;s regular prices, variants, categories and small, medium, large product images urls, and categories. Please attach with your sample of data extraction work with your application. Please do not apply if you can not provide. Also we will ask you to write a code and scrape some the above data listed to confirm you have experience in the job your applying for? We will test files to confirm products will upload properly before we hire you. We will not hire you until we know you can perform the job accurately. Thank you for applying! We look forward to hearing from you.
Skills: Scrapy Administrative Support Adobe Photoshop Copywriting
Fixed-Price - Intermediate ($$) - Est. Budget: $500 - Posted
Python Django backend dev with API experience required. Here is the basics of the web app you will be building on Django. -Get data via API's and scraping (approximately 10 sources in total) -Store in Django DB -Export data functionality via CSV -Export allows us to filter data, e.g. only include entries where data source =< 100 -Wrap the backend Python Django App in a Rest API -Make the backend functionality accessible via a basic HTML UI (view tables of data and make a new search) Much more detailed info and wireframes provided upon request. Once this basic version of the app is built we will require much more extensive additions. Looking to work with a developer on fixed price for this early stage with the view of more work to extend the application going forward.
Skills: Scrapy API Development Facebook Development LinkedIn Development