Lead Data Architect / Engineer – Microsoft Fabric Near Real-Time Lakehouse (10+ Sources)
Only freelancers located in the U.S. may apply.U.S. located freelancers only
Job Description:We are seeking an expert Microsoft Fabric Data Architect / Senior Data Engineer to design and stand up our core data platform from scratch. We thoroughly understand our internal business data but require an advanced Fabric skillset to build out a scalable, high-performing system.Key Responsibilities:Architecture Design: Establish a robust Medallion architecture (Bronze, Silver, Gold layers) within Fabric OneLake optimized for low-latency streaming.Ingestion Pipelines: Build and orchestrate scalable data ingestion for 13+ diverse data sources using Fabric Eventstreams, Data Factory Pipelines, or Dataflows Gen2.Real-Time Stream Processing: Implement a near-real-time streaming layer utilizing Fabric Eventhouses / KQL databases or optimized streaming PySpark notebooks.Performance Tuning: Optimize Delta tables and leverage Direct Lake mode for downstream semantic modeling to maintain real-time performance without data duplication.Required Qualifications:Extensive, proven experience implementing enterprise-level Microsoft Fabric Lakehouse environments.Strong mastery of the Medallion data-layering strategy.Deep expertise in streaming architectures, Kusto Query Language (KQL), and PySpark.Microsoft Certifications such as DP-600 (Fabric Analytics Engineer) or DP-700 (Fabric Data Engineer) are highly preferred.
- Less than 30 hrs/weekHourly
- < 1 monthDuration
- ExpertExperience Level
$20.00
-
$100.00
Hourly- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:2 days ago
- Interviewing:1
- Invites sent:3
- Unanswered invites:2
About the client
- United States11:18 AM
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by