Senior Data Engineer - AWS/Snowflake Pipeline Audit & Fix
Worldwide
We have an existing data pipeline (Python + AWS + Snowflake) that's underperforming, slow, unreliable, or not scaling well and needs a senior engineer to diagnose and fix it within 1-2 weeks. This is an audit + implementation engagement, not a build-from-scratch project. Scope of Work: - Review existing pipeline code (Python scripts, AWS setup, Snowflake schema/queries); access provided day 1. - Identify root cause(s): performance bottleneck, failure points, cost inefficiency, or data quality gap. - Implement fixes directly: query optimization, error handling, retry logic, warehouse sizing, or restructured dbt models. - Provide before/after benchmarks (run time, cost, or failure rate) - Short handoff doc: what was wrong, what was changed, follow-up recommendations Requirements: 1 - 5+ years of data engineering experience, production systems. 2 - Strong Python + AWS (S3, Lambda, IAM) hands-on experience. 3 - Snowflake performance tuning (query profiling, warehouse sizing, clustering); dbt experience a plus. 4 - Able to self-direct after a 30-min kickoff call. Deliverables: fixed/optimized pipeline, before/after metrics, handoff documentation Note: - Timeline: 1 - 2 weeks, starting within 2–3 days of hire. - Engagement Type: Hourly, possible follow-on work.
- Hours to be determinedHourly
- 1-3 monthsDuration
- ExpertExperience Level
$30.00
-
$60.00
Hourly- Remote Job
- Complex projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:9 minutes ago
- Interviewing:3
- Invites sent:4
- Unanswered invites:1
About the client
- CanadaCalgary3:35 PM
- Tech & ITSmall company (2-9 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by