Data Engineer to help build data platform

Posted 2 weeks ago

Worldwide

Summary

About the Role We're looking for a Senior Data Engineer to build our data platform from scratch, a rare greenfield opportunity to make the foundational architecture calls yourself. You'll design the pipelines that bring together high-volume payment transactions, marketing analytics, and operational data across AWS and GCP into a unified Lakehouse. This is a hands-on, ownership-heavy role. What You'll Do Design and build ingestion pipelines for high-volume payment data (Stripe, PayPal, Solidgate), marketing analytics (GA4, GTM, Google Ads, Amplitude), and operational databases (MongoDB, PostgreSQL). Build the data infrastructure for a Lakehouse using AWS and GCP. Build medallion-layer transformation models (Bronze → Silver → Gold) in dbt or SQLMesh, with payments on Redshift and marketing on BigQuery. Own orchestration end-to-end in Dagster or Airflow, lineage, sensors, backfills, retries, and alerting across the full asset graph. Implement infrastructure as code best practices, cost controls etc. What We're Looking For 3+ years building production data platforms and pipelines from the ground up. Deep expertise in Dagster or Airflow, including lineage, backfill, and retry strategies. Hands-on experience with dbt or SQLMesh, version-controlled transformations. Strong AWS and GCP skills, with Terraform for infrastructure as code and a cost-conscious (FinOps) approach. Strong written communication and the ability to work autonomously in a remote, async environment. Nice to Have Familiarity with data mesh principles, domain ownership, or data product design. Experience with Apache Spark or Flink for large-scale compaction workloads.

  • More than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Engineering
ETL Pipeline
Activity on this job
  • Proposals:50+
  • Last viewed by client:3 days ago
  • Hires:
    1
  • Interviewing:
    2
  • Invites sent:
    2
  • Unanswered invites:
    0
About the client
Member since May 17, 2022
  • Hong Kong
    Kowloon10:40 PM
  • $422K total spent
    179 hires, 109 active
  • 20,503 hours

Explore similar jobs on Upwork

Data Governance- Atlan, Unity CatalogHourly‐ Posted 4 weeks ago
Data Engineering
Data Engineer for API PipelinesHourly‐ Posted 5 days ago
Python
Data Integration
Database Architecture
Data Transformation
ETL Pipeline
Data Preprocessing
SQL
Database Design
Data Engineering
Data Migration
API Development
Tableau
Google Cloud Platform

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo