Python Scrapy Sample Code Few Lines

Search more jobs
Posted
Worldwide
Need a developer to write some sample code for me in Scrapy  . Code should do the following

1. Run scrapy program to scrape any website in a loop 100 times
2. Every time the program going through the loop and makes the call, it should get the proxy information from some file which stores the proxyies - there can be more than 1000 proxies so it will loop and pick 1 proxy host:port combo and then make the scrapy request.

How will I check it
1. I will give you a website where in on the back end I can see every call's Ip so when I run your code by updating the proxy file with my proxies list (1 item per line) then it I should see the different ips show up.

Good job for any one who knows scrapy python
  • $15.00
    Fixed-price
  • Entry level
    Experience Level
  • Remote Job
  • One-time project
    Project Type

Skills and Expertise

Scripting & Automation Skills
Scrapy
Other
Python

Activity on this job

  • 10 to 15
    Proposals
    10 to 15
  • 3 days ago
    Last viewed by client
    3 days ago
  • 1
    Hires
    1
  • 0
    Interviewing
    0
  • 0
    Invites sent
    0
  • 0
    Unanswered invites
    0

About the client

Member since Aug 13, 2018
  • United States
    Alpharetta 4:47 am
  • 221 jobs posted
    40% hire rate, 5 open jobs
  • $130,541 total spent
    114 hires, 5 active
  • $11.10 /hr avg hourly rate paid
    10,581 hours
  • Large company (100-1,000 people)
  • Member since Aug 13, 2018

Explore similar jobs on Upwork

Looking for MS Teams App developer
New
Hourly ‐ Posted 21 minutes ago
Microsoft Teams .NET Core TypeScript
Script for Jira
New
Fixed-price ‐ Posted 57 minutes ago
Jira API

How it works

Post a job icon
Create your free profile

Highlight your skills and experience, show your portfolio, and set your ideal pay rate.

Talent comes to you icon
Work the way you want

Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.

Payment simplified icon
Get paid securely

From contract to payment, we help you work safely and get paid securely.

Want to get started?

About Upwork

Stars rating
4.9/5
(Average rating of clients by professionals)
G2 2021
#1 freelance platform
49,000+
Signed contract every week
$2.3B
Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by
Microsoft Logo Airbnb Logo Bissell Logo GoDaddy Logo