Data Engineer to help build data platform

Posted 6 hours ago

Worldwide

Summary

About the Role We're looking for a Senior Data Engineer to build our data platform from scratch, a rare greenfield opportunity to make the foundational architecture calls yourself. You'll design the pipelines that bring together high-volume payment transactions, marketing analytics, and operational data across AWS and GCP into a unified Lakehouse. This is a hands-on, ownership-heavy role. What You'll Do Design and build ingestion pipelines for high-volume payment data (Stripe, PayPal, Solidgate), marketing analytics (GA4, GTM, Google Ads, Amplitude), and operational databases (MongoDB, PostgreSQL). Build the data infrastructure for a Lakehouse using AWS and GCP. Build medallion-layer transformation models (Bronze → Silver → Gold) in dbt or SQLMesh, with payments on Redshift and marketing on BigQuery. Own orchestration end-to-end in Dagster or Airflow, lineage, sensors, backfills, retries, and alerting across the full asset graph. Implement infrastructure as code best practices, cost controls etc. What We're Looking For 3+ years building production data platforms and pipelines from the ground up. Deep expertise in Dagster or Airflow, including lineage, backfill, and retry strategies. Hands-on experience with dbt or SQLMesh, version-controlled transformations. Strong AWS and GCP skills, with Terraform for infrastructure as code and a cost-conscious (FinOps) approach. Strong written communication and the ability to work autonomously in a remote, async environment. Nice to Have Familiarity with data mesh principles, domain ownership, or data product design. Experience with Apache Spark or Flink for large-scale compaction workloads.

  • More than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Engineering
ETL Pipeline
Activity on this job
  • Proposals:50+
  • Last viewed by client:6 hours ago
  • Interviewing:
    2
  • Invites sent:
    3
  • Unanswered invites:
    1
About the client
Member since May 17, 2022
  • Hong Kong
    Kowloon6:25 PM
  • $410K total spent
    173 hires, 105 active
  • 19,748 hours

Explore similar jobs on Upwork

Database University AssignmentsHourly‐ Posted 9 months ago
SQL
Database
Microsoft Excel
Database Design
Database Management
SQL Server Integration Services
Excel Macros
Excel Formula
Microsoft Power BI
Microsoft Excel PowerPivot
Power Query
Data Entry
Data Cleaning
Data Analytics
Data Extraction
AWS Glue
Apache Kafka
Python
HubSpot
Salesforce CRM
REST API
Node.js

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo