Online Marketplace Scraper for Market Research (Public Listing Data

Posted 4 days ago

Worldwide

Summary

We're looking for an experienced scraping developer to build (or extend) a pipeline that extracts public resale market data from eBay and similar marketplaces for internal business analytics. What we need: -A scraper that pulls active and sold listing counts (and ideally average sold price) for a list of brand/product search terms -Input: CSV of brand names/domains -Output: clean CSV with active count, sold count, avg price per brand, ready to import into Google Sheets/HubSpot Should run efficiently at scale (tens of thousands of lookups per batch eventually) — comfortable with proxy rotation, rate limiting, and running on a low-cost host (e.g., Vast.ai) rather than expensive managed scraping infra -Bonus: experience with Apify actors or similar tools that can return aggregate sold-listing counts directly, which could replace parts of a custom scraper -All data pulled is publicly visible on marketplace search result pages — no login-gated or private data involved -This should be a fully documented, standalone deliverable — we want to be able to run, maintain, and modify the scraper ourselves after handoff, without ongoing dependency on the freelancer. Ideal skills: -Python strongly preferred (to integrate with our existing internal pipeline); will consider other stacks if the output format and hosting approach fit -Experience with anti-bot handling, proxies, and rate limiting at scale -Familiarity with Apify or comparable scraping-as-a-service platforms is a plus -Comfortable working from a technical spec and iterating quickly Project structure & budget: This is a fixed-price engagement for an initial working version, split into two milestones: Milestone 1 — 40% of total: Working prototype against a small test batch (~20–30 brands), demonstrating the scraping approach, output format, and handling of edge cases (no results, ambiguous brand names, rate limiting behavior) Milestone 2 — 60% of total: Final delivery — full sample batch (~100–200 brands) run end-to-end, clean CSV output matching spec, plus documentation and setup instructions sufficient for us to run and maintain the scraper independently (config, dependencies, how to scale batch size, how to rotate proxies/API keys). To apply: Please share a past example of a scraper you've built (ideally against eBay or another marketplace with bot protection) and your approach to handling scale cost-effectively.

  • $800.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Web Scraping
API
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:4 days ago
  • Interviewing:
    6
  • Invites sent:
    2
  • Unanswered invites:
    0
About the client
Member since Jun 6, 2023
  • United States
    San Francisco2:11 AM
  • $125K total spent
    25 hires, 18 active
  • 23,056 hours
  • Retail & Consumer Goods
    Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Screencast META APIHourly‐ Posted 4 days ago
Facebook Graph API
Instagram API
Facebook Messenger
Facebook Development
CodeIgniter
Chatbot Development
Social Media Account Integration
Laravel
Marketing Automation Software
Payment Gateway Integration
SaaS
API Development
Social Media Account Setup
API Integration
Web Development
JavaScript
Node.js
PHP
Web Application
AI App Development
DevOps
API
Git
MySQL

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo