Web Scraper for Equipment Directory (Daily Data Sync)

Posted yesterday

Worldwide

Summary

I need a developer to build a web scraper for liftstoday.com, an online equipment directory, to serve as a replacement for a backend API connection. The scraper should crawl the site and pull in all listing data (equipment details, specs, pricing, images, categories, and any associated metadata), then feed it into a website I'm currently editing. It must run on an automated schedule — daily at minimum, more frequently if feasible — and reliably handle updates, new listings, and removed listings. Deliverables include the scraper, a scheduled/automated pipeline, and clean structured output (e.g. JSON or database records) ready to integrate. Please share relevant experience with scraping, scheduling, and anti-bot handling, and note your preferred tech stack.

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Scraping
Web Crawling
Nice-to-have skills
Scrapy
Data Mining
Activity on this job
  • Proposals:50+
  • Last viewed by client:10 hours ago
  • Interviewing:
    8
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jun 19, 2019
  • United States
    Castro Valley8:12 PM
  • $291K total spent
    49 hires, 17 active
  • 6,553 hours
  • Engineering & Architecture
    Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Web Scraping + ongoing maintenanceHourly‐ Posted 1 month ago
Screen Scraping
Web Scraping
Web Crawling
Data Extraction
API Integration
Data Integration
Data Scraping
List Building
Data Mining
API
Recruiting
Administrative Support
Data Entry
English
Social Media Marketing
Project Management

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo