You will get Spark performance optimization and Databricks workload rescue
Top Rated
Top Rated
Project details
I help teams fix slow Databricks notebooks and Spark jobs by identifying the true performance bottlenecks and applying practical, production-ready optimizations. This project stands out because it combines technical depth, code-level tuning, and clear recommendations focused on real speed, stability, and cost improvements.
What's included
| Service Tiers |
Starter
$595
|
Standard
$1,350
|
Advanced
$2,450
|
|---|---|---|---|
| Delivery Time | 4 days | 7 days | 12 days |
Number of Revisions | 1 | 2 | 2 |
Schema Diagram | - | - | - |
Permissions Setup | - | - | - |
Import/Export Data | - | - | - |
Admin Panel Setup | - | - | - |
Frequently asked questions
9 reviews
(9)
(0)
(0)
(0)
(0)
This project doesn't have any reviews.
AY
Anush Y.
Dec 2, 2024
Senior Spark Engineer | Trainer/Code Reviewer For LLM Data Training
ZB
Zack B.
Aug 27, 2024
Business Analysis, Exploratory Data Analysis, Data Validation.
MW
Marcia W.
Aug 2, 2024
Data Analyst needed to create Exploratory Data Analysis report
Prabar has worked with us for the last 3 years. He has been an invaluable asset to the team and in that time has contributed to scaling our product from MVP to a growing platform. His innovative approach to problem-solving has brought fresh perspectives to our data analysis and he has continuously improved his skills by staying up to date with the latest trends and tools in data science. We highly recommend him.
MB
Michael B.
Aug 22, 2023
An enterprise client is seeking for a Machine Learning Developer
Thank you for the great service and quick turnaround !!!
MR
MILLIE R.
Aug 15, 2023
AI BASED, SKIN ANALYSIS APP
Prabar is wonderful to work with. He is professional and has all the skills and experience to get the job done.
About Prabar
Data Analytics Engineer | Data/ML Pipelines | PySpark | Azure | MLOps
100%
Job Success
Bhubaneshwar, India - 4:13 am local time
For existing data analytics setups, I build, fix, and optimize Databricks data pipelines and ML workflows using PySpark, Spark SQL, Delta Lake, Azure Data Factory, ADLS, Unity Catalog, and MLflow.
Most of my work is around production Databricks systems: ingestion pipelines, bronze/silver/gold lakehouse architecture, Delta Lake optimization, Spark performance tuning, Unity Catalog governance, and MLOps workflows using MLflow.
I can help you with:
➡️ Building Databricks pipelines using PySpark, Spark SQL, Delta Lake, and Databricks Workflows
➡️ Designing Lakehouse medallion architectures with bronze, silver, and gold layers
➡️ Creating reporting-ready gold-layer datasets for Power BI and Apache Superset
➡️ Building KPI metrics, statistical models, and ML pipelines on Databricks using
➡️ Fixing slow Spark jobs, expensive joins, memory issues, and inefficient writes
➡️ Optimizing Delta tables and Spark workloads
➡️ Migrate ERP and operational financial reports from legacy systems to Databricks, Delta Lake and PowerBI/ Tableau.
➡️ Building Azure data pipelines using Azure Data Factory, ADLS, Azure Databricks, and SQL
➡️ Setting up Unity Catalog governance, permissions, external locations, and secure data access
➡️ Productionizing ML workflows using MLflow, model registry, experiment tracking, and Databricks MLOps
I bring around 8 years of experience across data engineering, data science, analytics, and cloud platforms. I focus on practical, production-ready solutions that are scalable, maintainable, and easy for teams to use.
Core skills: Databricks, PySpark, Spark SQL, Delta Lake, Delta Live Tables, Unity Catalog, MLflow, Azure Data Factory, ADLS, Azure Databricks, SQL, Python, Power BI, Apache Superset, Kafka, Docker, Git, CI/CD, MLOps.
Steps for completing your project
After purchasing the project, send requirements so Prabar can start the project.
Delivery time starts when Prabar receives requirements from you.
Prabar works on your project following the steps below.
Revisions may occur after the delivery date.
Bottleneck Analysis
Code Optimization