Senior Data Engineer for Web Scraping

Posted 2 hours ago

Worldwide

Summary

We are building an in-house real estate data engine to scrape, clean, and enrich over 500,000 property records weekly across the US. We need an expert Data Engineer to architect a distributed scraping pipeline and spatial database that bypasses anti-bot defenses, normalizes public records, and routes enriched data to CRM APIs. Responsibilities include building scalable scrapers for county assessor portals and GIS APIs, configuring rotating residential proxies, and designing a PostgreSQL/PostGIS and Elasticsearch system for property searches, land-use filters, and Census data. Experience with anti-bot bypass, high-throughput proxy rotation, and US real estate data is essential.

More than 30 hrs/week
Hourly
6+ months
Duration
Expert
Experience Level
Remote Job
Complex project
Project Type

Skills and Expertise

Mandatory skills

Python

Machine Learning

Nice-to-have skills

Selenium

Scrapy

Activity on this job

Proposals:20 to 50
Last viewed by client:48 minutes ago
Interviewing:
1
Invites sent:
0
Unanswered invites:
0

About the client

Member since Aug 6, 2026

United States
6:30 PM

Explore similar jobs on Upwork

Environment & Build Pipeline LockFixed-price‐ Posted 3 weeks ago

Java

DevOps

Deployment Automation

Data Quality EngineerHourly‐ Posted 3 weeks ago

Amazon Web Services

Microsoft Azure

Cloud Computing

Apache Airflow

ETL

BigQuery

CI/CD

Databricks Platform

GitLab

Apache Kafka

Docker

Analytics

Machine Learning

Apache Hadoop

MySQL

How it works

Create your free profile
Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you want
Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securely
From contract to payment, we help you work safely and get paid securely.