Senior Data Engineer - AWS/Snowflake Pipeline Audit & Fix

Posted 2 hours ago

Worldwide

Summary

We have an existing data pipeline (Python + AWS + Snowflake) that's underperforming, slow, unreliable, or not scaling well and needs a senior engineer to diagnose and fix it within 1-2 weeks. This is an audit + implementation engagement, not a build-from-scratch project. Scope of Work: - Review existing pipeline code (Python scripts, AWS setup, Snowflake schema/queries); access provided day 1. - Identify root cause(s): performance bottleneck, failure points, cost inefficiency, or data quality gap. - Implement fixes directly: query optimization, error handling, retry logic, warehouse sizing, or restructured dbt models. - Provide before/after benchmarks (run time, cost, or failure rate) - Short handoff doc: what was wrong, what was changed, follow-up recommendations Requirements: 1 - 5+ years of data engineering experience, production systems. 2 - Strong Python + AWS (S3, Lambda, IAM) hands-on experience. 3 - Snowflake performance tuning (query profiling, warehouse sizing, clustering); dbt experience a plus. 4 - Able to self-direct after a 30-min kickoff call. Deliverables: fixed/optimized pipeline, before/after metrics, handoff documentation Note: - Timeline: 1 - 2 weeks, starting within 2–3 days of hire. - Engagement Type: Hourly, possible follow-on work.

  • Hours to be determined
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • $30.00

    -

    $60.00

    Hourly
  • Remote Job
  • Complex project
    Project Type
Skills and Expertise
Mandatory skills
Snowflake
ETL Pipeline
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:9 minutes ago
  • Interviewing:
    3
  • Invites sent:
    4
  • Unanswered invites:
    1
About the client
Member since Jul 6, 2026
  • Canada
    Calgary3:35 PM
  • Tech & IT
    Small company (2-9 people)

Explore similar jobs on Upwork

Graph & Database EngineerHourly‐ Posted 5 days ago
Graph Database
Ontology
JSON-LD
GTM EngineerHourly‐ Posted 2 months ago
Clay
LinkedIn Campaign Manager
Lead Generation Strategy

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo