Online Marketplace Scraper for Market Research (Public Listing Data
Worldwide
We're looking for an experienced scraping developer to build (or extend) a pipeline that extracts public resale market data from eBay and similar marketplaces for internal business analytics. What we need: -A scraper that pulls active and sold listing counts (and ideally average sold price) for a list of brand/product search terms -Input: CSV of brand names/domains -Output: clean CSV with active count, sold count, avg price per brand, ready to import into Google Sheets/HubSpot Should run efficiently at scale (tens of thousands of lookups per batch eventually) — comfortable with proxy rotation, rate limiting, and running on a low-cost host (e.g., Vast.ai) rather than expensive managed scraping infra -Bonus: experience with Apify actors or similar tools that can return aggregate sold-listing counts directly, which could replace parts of a custom scraper -All data pulled is publicly visible on marketplace search result pages — no login-gated or private data involved -This should be a fully documented, standalone deliverable — we want to be able to run, maintain, and modify the scraper ourselves after handoff, without ongoing dependency on the freelancer. Ideal skills: -Python strongly preferred (to integrate with our existing internal pipeline); will consider other stacks if the output format and hosting approach fit -Experience with anti-bot handling, proxies, and rate limiting at scale -Familiarity with Apify or comparable scraping-as-a-service platforms is a plus -Comfortable working from a technical spec and iterating quickly Project structure & budget: This is a fixed-price engagement for an initial working version, split into two milestones: Milestone 1 — 40% of total: Working prototype against a small test batch (~20–30 brands), demonstrating the scraping approach, output format, and handling of edge cases (no results, ambiguous brand names, rate limiting behavior) Milestone 2 — 60% of total: Final delivery — full sample batch (~100–200 brands) run end-to-end, clean CSV output matching spec, plus documentation and setup instructions sufficient for us to run and maintain the scraper independently (config, dependencies, how to scale batch size, how to rotate proxies/API keys). To apply: Please share a past example of a scraper you've built (ideally against eBay or another marketplace with bot protection) and your approach to handling scale cost-effectively.
$800.00
Fixed-price- IntermediateExperience Level
- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:4 days ago
- Interviewing:6
- Invites sent:2
- Unanswered invites:0
About the client
- United StatesSan Francisco2:11 AM
- $125K total spent25 hires, 18 active
- 23,056 hours
- Retail & Consumer GoodsMid-sized company (10-99 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by