Microsoft Fabric Data Engineer – Pipeline & Stored Procedure Troubleshooting

Posted 2 hours ago

Worldwide

Summary

I’m looking for an experienced Microsoft Fabric Data Engineer to help me troubleshoot and restore a data pipeline that’s currently failing. We’ll work together in a live screen-sharing session (no direct access to my environment will be provided). The issue started after source files on the SFTP had renamed column headers on Monday. The files have since been corrected and the expected headers are back, but the pipeline is still failing at the stored procedure step. I suspect the stored procedure may still be referencing column_1 instead of the original header names. The pipeline includes SQL stored procedures, Python notebooks, Dataflow Gen2, SFTP ingestion, and Microsoft Fabric pipelines. Some files intentionally use generic column names (such as column_1) because the notebook removes headers and footers, while other files contain actual headers. Experience troubleshooting both scenarios is required. Skills needed: ● Microsoft Fabric Pipelines ● SQL & Stored Procedures ● Python Notebooks ● Dataflow Gen2 ● SFTP File Ingestion ● Data Pipeline Troubleshooting I’ll be available today starting around 8:30 PM–9:00 PM EST and would like to work together until the issue is identified and the pipeline is restored.

  • Less than 30 hrs/week
    Hourly
  • < 1 month
    Duration
  • Intermediate
    Experience Level
  • $5.00

    -

    $10.00

    Hourly
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Data Engineering
ETL Pipeline
Activity on this job
  • Proposals:5 to 10
  • Last viewed by client:1 minute ago
  • Interviewing:
    2
  • Invites sent:
    1
  • Unanswered invites:
    1
About the client
Member since May 22, 2023
  • United States
    Riviera Beach5:58 PM
  • $1.2K total spent
    16 hires, 1 active
  • 11 hours

Explore similar jobs on Upwork

Graph & Database EngineerHourly‐ Posted 1 week ago
Graph Database
Ontology
JSON-LD
Senior Data EngineerHourly‐ Posted 2 weeks ago
Python
Docker
Kubernetes
SAS
Apache Kafka
Amazon Web Services
BigQuery
SQL
CI/CD

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo