Implement end-to-end data engineering solutions for business analytics on Microsoft Fabric

Posted 3 days ago

Worldwide

Needs to hire 3 Freelancers
Summary

The Company: Dimensional Strategies Inc. (DSI), is a premier Microsoft partner located in the GTA, Ontario, Canada. Our customer base extends across Canada and the contiguous US states. DSI’s primary goal is to help our customers execute their business processes more efficiently and effectively via investments in applications and analytics. Core practices include Cloud Infrastructure, Application Development, Data Engineering & Analytics, and Managed Services. The Position: Participate in the end-to-end execution and delivery of our data platform projects that focus on ingesting and curating data for analytical consumption. You will be using DSI's flagship in-house metadata-driven framework for Microsoft Fabric that is based on Medallion Lakehouse architecture. You will work with the DSI data engineering team and use data engineering specifications to create production-ready data pipelines across Bronze (ingestion), Silver (cleansing), and Gold (curation) layers. This is a hands-on delivery role - not architecture, not requirements gathering, not custom data engineering or data science. What You'll Do · Bootstrap and provision new customer environments in Microsoft Fabric · Author and maintain YAML-based pipeline configurations for all data layers · Deploy configurations and artifacts to Microsoft Fabric via CI/CD pipelines · Configure data ingestion from various data sources including REST API, file sources, and SQL databases · Define merge strategies, column transformations, and data quality rules · Validate pipeline outputs by running notebooks and verifying table data in Fabric · Debug pipeline failures using logs, tracing config errors to resolution · Manage multiple environments (dev, test, production) across customer projects · Collaborate with the DSI data engineers that define the specs for the solutions What You Won't Do · Gather requirements or collaborate with customers · Write or modify the data engineering specification · Perform custom data engineering or research in Microsoft Fabric · Perform business analysis · Design solution architecture from scratch Primary Qualifications · Multiple years of dedicated data engineering experience · Strong SQL skills with Spark SQL and T-SQL - window functions, CTEs, aggregations, CASE expressions · Experience with Lakehouse architecture in Microsoft Fabric including Delta tables, and semi-structured file formats · Solid understanding of Medallion architecture (Bronze/Silver/Gold) or equivalent layered data patterns · Experience with REST API integrations - authentication, pagination, JSON response handling · Familiarity with merge/upsert patterns (SCD Type-1, Type-2, overwrite, append) · Proficiency with Git - branching, pull requests, merge conflict resolution · Comfortable reading and authoring YAML configurations · Understanding of Apache Spark concepts — partitions, lazy evaluation, actions vs transforms Nice to have Qualifications · Exposure to CI/CD pipelines (Azure DevOps or GitHub Actions) · Basic Python reading ability (not writing production code, but can trace logic) · Familiarity with expression languages like Jinja2 · Experience with Python scripts execution · Experience with PowerShell scripts execution · KQL / Kusto query experience for log analysis · Databricks or Azure Synapse experience Work Environment · Fully remote with flexible time management · Initially supervised by DSI team members, progressing to semi-autonomous and then fully autonomous delivery responsibilities · Multi-customer project rotation · Work in a mature well-documented Microsoft/GitHub enterprise environment using established patterns and templates

  • Less than 30 hrs/week
    Hourly
  • 3-6 months
    Duration
  • Intermediate
    Experience Level
  • $30.00

    -

    $50.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Data Engineering
Data Integration
Activity on this job
  • Proposals:50+
  • Last viewed by client:2 days ago
  • Interviewing:
    27
  • Invites sent:
    1
  • Unanswered invites:
    0
About the client
Member since Oct 2, 2019
  • Canada
    Mississauga1:44 AM
  • $333K total spent
    35 hires, 8 active
  • 7,021 hours
  • Large company (100-1,000 people)

Explore similar jobs on Upwork

Graph & Database EngineerHourly‐ Posted 3 days ago
Graph Database
Ontology
JSON-LD
GTM EngineerHourly‐ Posted 2 months ago
Clay
LinkedIn Campaign Manager
Lead Generation Strategy

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo