Senior Data Engineer: Design & Build Automated Python ETL Pipelines with Power BI Reporting Layer

Posted 8 hours ago

Worldwide

Summary

We’ve grown fast and our data is a mess — CRM exports, a PostgreSQL production database, and weekly CSV drops from 3 vendors. Nothing is connected. Our team makes decisions from stale spreadsheets. We need a senior data engineer to design a proper pipeline, automate the data flow, and give our leadership team a Power BI dashboard that actually reflects reality every morning. This is not a junior task. We’ve tried before and got unmaintainable spaghetti code. We need someone who thinks in schemas, writes clean modular Python, documents as they go, and treats data quality as a first-class concern — not an afterthought. SCOPE OF WORK • Audit all 3 data sources and design a unified star-schema analytical model • Build modular Python ETL scripts: extract from API + PostgreSQL + CSV, transform, load to analytical layer • Implement data quality checks at every stage: null handling, deduplication, type validation, anomaly alerts • Set up automated daily scheduling (cron / Airflow) so data refreshes without manual intervention • Connect final analytical tables to Power BI; build 2–3 core dashboards (sales, ops, pipeline) • Deliver full documentation: data dictionary, pipeline diagram, runbook for the internal team • 2-week handover support period after delivery — answer questions, fix edge cases

  • $300.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
PySpark
Apache Airflow
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:47 minutes ago
  • Interviewing:
    1
  • Invites sent:
    1
  • Unanswered invites:
    0
About the client
Member since May 14, 2017
  • Egypt
    Alexandria4:44 PM
  • $695 total spent
    3 hires, 0 active
  • 20 hours

Explore similar jobs on Upwork

Database University AssignmentsHourly‐ Posted 9 months ago
SQL
Database
Microsoft Excel
Database Design
Database Management
SQL Server Integration Services
Excel Macros
Excel Formula
Microsoft Power BI
Microsoft Excel PowerPivot
Power Query
Data Entry
Data Cleaning
Data Analytics
Data Extraction
AWS Glue
Apache Kafka
Python
HubSpot
Salesforce CRM
REST API
Node.js

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo