Scraping , Data Extraction, Automation Expert
Worldwide
We’re looking for an experienced Python/web scraping developer to build a system that can automatically find a company’s manufacturing plants, warehouses, distribution centers, and fulfillment centers using official company sources. What the system should do The system will receive a company name + website domain and automatically search sources such as: Company websites and subdomains Supplier/vendor portals Career pages and job postings PDFs and spreadsheets Facility/location pages Interactive maps Public APIs used by company websites It should identify relevant facilities and return: Facility name Address City/location Facility type Source URL Supporting evidence from the source The system should exclude offices, retail stores, R&D locations, and other non-operational facilities. Important: This must be a general system We do not want a separate scraper built for each company. The goal is to create a reusable system that works across many different companies and website structures. For example, the same system should be able to research different companies without requiring custom code for each one. Technologies / experience You should have strong experience with: Python Web scraping and automation Playwright, Selenium, Scrapy, or similar tools JavaScript-rendered websites Inspecting APIs and interactive maps PDF and Excel/CSV extraction LLMs for classification and data extraction Data cleaning, normalization, and duplicate detection Accuracy is very important We care more about reliable results than finding every possible facility. Every facility should have a clear source and supporting evidence. The system should also be able to identify uncertain results and assign confidence/review statuses. Research should stop after a defined number of official sources rather than continuing indefinitely. What we'd like from you Please describe: Similar web scraping/data extraction systems you have built. How you would design this as a company-agnostic system. How you would handle websites, APIs, PDFs, spreadsheets, maps, and job postings. How you would verify facilities and avoid false positives. Your preferred technology stack. We’re looking for someone who can build clean, maintainable, well-documented code and create a system that can improve over time as we test it on different companies.
- More than 30 hrs/weekHourly
- 1-3 monthsDuration
- ExpertExperience Level
$10.00
-
$20.00
Hourly- Remote Job
- Ongoing projectProject Type
Skills and Expertise
Activity on this job
- Proposals:15 to 20
- Last viewed by client:2 hours ago
- Interviewing:8
- Invites sent:30
- Unanswered invites:18
About the client
- IDNJakarta11:38 AM
- $2.1K total spent26 hires, 3 active
- 131 hours
- Health & FitnessSmall company (2-9 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by