Databricks Data Engineer | PySpark, Azure, ETL & Delta Lake

Posted 5 days ago

Worldwide

Summary

Looking for a Databricks Data Engineer to support the development and optimization of healthcare data pipelines. The work involves building ETL pipelines for claims data, transforming source Excel/CSV files into structured Delta tables, and working across Bronze, Silver, and Gold layers in Databricks. Key skills: Azure Databricks PySpark, Python & SQL Delta Lake & Medallion Architecture ETL/Data Pipelines Apache Airflow Azure Data Lake Storage (ADLS) Databricks Workflows & Jobs Data Quality & Validation Schema Evolution Performance Optimization Git, Azure DevOps & CI/CD Looking for someone comfortable working with existing pipelines as well as building new data transformations and tables from scratch.

Less than 30 hrs/week
Hourly
1-3 months
Duration
Intermediate
Experience Level
$9.00
-
$13.00
Hourly
Remote Job
Ongoing project
Project Type

Skills and Expertise

Mandatory skills

Databricks Platform

PySpark

Activity on this job

Proposals:20 to 50
Last viewed by client:5 days ago
Hires:
1
Interviewing:
0
Invites sent:
0
Unanswered invites:
0

About the client

Member since Aug 30, 2022

United States
Mcdonough7:27 AM
$11K total spent
62 hires, 12 active
233 hours

Explore similar jobs on Upwork

Big Data SpecialistHourly‐ Posted 3 weeks ago

Snowflake

Databricks Platform

Scala

Apache Spark

Big Data

Python

Apache Hadoop

CI/CD Platform

Terraform

Azure DevOps

AI + Data EngineerFixed-price‐ Posted 3 weeks ago

Python

Artificial Intelligence

Data Science

How it works

Create your free profile
Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you want
Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securely
From contract to payment, we help you work safely and get paid securely.