Web Scraping Specialist for Custom Data Collection

Posted yesterday

Worldwide

Summary

We are looking for an experienced Web Scraping Developer to help us build reliable and scalable web scraping solutions. 1. Responsibilities - Develop and maintain custom web scrapers and data extraction tools. - Scrape data from websites with different structures and technologies. - Handle pagination, dynamic content, JavaScript-rendered pages, and complex website structures. - Clean, validate, and structure scraped data. - Build solutions that can run reliably on a scheduled basis. - Implement appropriate error handling, logging, retries, and monitoring. - Maintain and update scrapers when website structures change. - Deliver clean, well-documented, and maintainable code. 2. Required Skills - Strong experience with Python and web scraping. - Experience with BeautifulSoup, Scrapy, Selenium, Playwright, or similar tools. - Good understanding of HTML, CSS, JavaScript, HTTP requests, and APIs. - Experience working with JSON, CSV, Excel, and database storage. - Knowledge of PostgreSQL, MySQL, MongoDB, or other databases is a plus. - Experience handling dynamic websites and browser automation. - Ability to troubleshoot scraping failures and website changes. - Familiarity with Git and good coding practices. We need someone who can take ownership of scraping projects, understand requirements quickly, and deliver reliable results rather than just writing basic scripts. Please include: - Your experience with web scraping. - Examples of similar scraping projects you have completed. - Which scraping technologies you commonly use. - Your availability and estimated hourly rate. - Your GitHub or portfolio, if available. We are looking for a long-term developer if the initial project goes well.

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • $5.00

    -

    $30.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Selenium
JavaScript
Data Scraping
Activity on this job
  • Proposals:50+
  • Last viewed by client:30 minutes ago
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since May 14, 2023
  • United States
    Hammonton10:38 PM
  • $18K total spent
    61 hires, 31 active
  • 1,202 hours

Explore similar jobs on Upwork

Artificial Intelligence
AI Agent Development
Automation
AI Development
Python
AI App Development
Document AI
Generative AI
AI Bot
AI Chatbot
Data Extraction
LLM Prompt Engineering
LangChain
OCR Algorithm
Prompt Engineering
Claude
n8n
AI Implementation
Retrieval Augmented Generation
AI Model Integration
ETL
Airtable
Database Design
Automation
No-Code Development
Data Migration
Zapier
Customer Relationship Management

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo