Scraping , Data Extraction, Automation Expert

Posted 3 hours ago

Worldwide

Summary

We’re looking for an experienced Python/web scraping developer to build a system that can automatically find a company’s manufacturing plants, warehouses, distribution centers, and fulfillment centers using official company sources. What the system should do The system will receive a company name + website domain and automatically search sources such as: Company websites and subdomains Supplier/vendor portals Career pages and job postings PDFs and spreadsheets Facility/location pages Interactive maps Public APIs used by company websites It should identify relevant facilities and return: Facility name Address City/location Facility type Source URL Supporting evidence from the source The system should exclude offices, retail stores, R&D locations, and other non-operational facilities. Important: This must be a general system We do not want a separate scraper built for each company. The goal is to create a reusable system that works across many different companies and website structures. For example, the same system should be able to research different companies without requiring custom code for each one. Technologies / experience You should have strong experience with: Python Web scraping and automation Playwright, Selenium, Scrapy, or similar tools JavaScript-rendered websites Inspecting APIs and interactive maps PDF and Excel/CSV extraction LLMs for classification and data extraction Data cleaning, normalization, and duplicate detection Accuracy is very important We care more about reliable results than finding every possible facility. Every facility should have a clear source and supporting evidence. The system should also be able to identify uncertain results and assign confidence/review statuses. Research should stop after a defined number of official sources rather than continuing indefinitely. What we'd like from you Please describe: Similar web scraping/data extraction systems you have built. How you would design this as a company-agnostic system. How you would handle websites, APIs, PDFs, spreadsheets, maps, and job postings. How you would verify facilities and avoid false positives. Your preferred technology stack. We’re looking for someone who can build clean, maintainable, well-documented code and create a system that can improve over time as we test it on different companies.

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • $10.00

    -

    $20.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
Data Scraping
Data Extraction
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:3 hours ago
  • Interviewing:
    12
  • Invites sent:
    30
  • Unanswered invites:
    12
About the client
Member since Nov 12, 2024
  • IDN
    Jakarta12:35 PM
  • $2.1K total spent
    26 hires, 3 active
  • 131 hours
  • Health & Fitness
    Small company (2-9 people)

Explore similar jobs on Upwork

Artificial Intelligence
AI Agent Development
Automation
AI Development
Python
AI App Development
Document AI
Generative AI
AI Bot
AI Chatbot
Data Extraction
LLM Prompt Engineering
LangChain
OCR Algorithm
Prompt Engineering
Claude
n8n
AI Implementation
Retrieval Augmented Generation
AI Model Integration
ETL
Airtable
Database Design
Automation
No-Code Development
Data Migration
Zapier
Customer Relationship Management

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo