Developer Required for E-commerce Scraper Implementation

Posted 2 weeks ago

Worldwide

Summary

We are looking for an experienced developer to build and implement web scrapers for around 7 e-commerce websites. The scraper should collect product-related data such as product name, price, stock availability, product URL, image URL, brand, category, and other available product details. The data should be structured and exported in a clean format for further use. Scope of Work The developer will be responsible for: 1. Building scrapers for approximately 7 e-commerce websites. Extracting product details, pricing, stock status, images, and product URLs. 2. Handling pagination, categories, and product listing pages. 3. Managing price and stock updates on a scheduled basis. 4. Ensuring data accuracy and avoiding duplicate products. 5. Providing clean output in CSV, Excel, database, or API format. 6. Setting up error logs and basic monitoring for failed scrapes. 7. Ensuring the scraper follows best practices and works with publicly available data only. Deliverables 1. Fully working scrapers for all assigned websites. 2. Structured product data output. 3. Documentation on how to run and maintain the scrapers. 4. Source code with setup instructions. 5. Basic error handling and logs. 6. Scheduled scraping setup. Questions for Applicants 1. Have you built e-commerce scrapers before? Please share examples. 2. Which scraping tools or frameworks do you prefer using? 3. Can you handle JavaScript-heavy websites? 4. How do you manage blocked requests, rate limits, and failed scrapes? 5. Can you provide clean documentation and reusable code? 6. What timeline would you suggest for implementing scrapers for 7 websites?

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Extraction
API Integration
Activity on this job
  • Proposals:15 to 20
  • Last viewed by client:2 weeks ago
  • Interviewing:
    16
  • Invites sent:
    21
  • Unanswered invites:
    4
About the client
Member since Mar 21, 2020
  • India
    Mumbai4:46 PM

Explore similar jobs on Upwork

Job Aggregation and Dashboard CreationHourly‐ Posted 8 months ago
Automation
Data Scraping
Data Extraction
API
UI/UX Prototyping
Web Scraping
Install and Integrate UTM Grabber PluginFixed-price‐ Posted 3 weeks ago
WordPress

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo