You will get scalable ETL pipelines using Databricks, Snowflake, and Spark
Project details
Need robust, high-performance data pipelines? I’ll design and deploy scalable ETL/ELT workflows using Databricks, Apache Spark, and Snowflake. Whether it’s data migration, cleaning, transformation, or ingestion from APIs and databases — I’ve got you covered.
Deliverables:
Custom Spark/Databricks notebooks or workflows
Schema harmonization and data deduplication
Integration with Snowflake, SQL Server, S3, or Delta Lake
Scheduled jobs and monitoring
Documentation and handoff
Tags: #Databricks #ETL #DataEngineering #Snowflake #Spark #Azure
Deliverables:
Custom Spark/Databricks notebooks or workflows
Schema harmonization and data deduplication
Integration with Snowflake, SQL Server, S3, or Delta Lake
Scheduled jobs and monitoring
Documentation and handoff
Tags: #Databricks #ETL #DataEngineering #Snowflake #Spark #Azure
Database Type
MySQL, MS SQL, MS Access, Oracle, SQLite, PostgreSQL, MongoDB, Couchbase, Teradata, Realm Database, Azure Cosmos DB, LevelDBWhat's included
| Service Tiers |
Starter
$10
|
Standard
$100
|
Advanced
$1,000
|
|---|---|---|---|
| Delivery Time | 1 day | 7 days | 30 days |
Number of Revisions | Unlimited | Unlimited | Unlimited |
Schema Diagram | - | - | - |
Permissions Setup | - | - | - |
Import/Export Data | - | - | - |
Admin Panel Setup | - | - | - |
About Shafee Ul Kabir
AI & Data Engineering Expert | Azure, Databricks, NLP, Analytics
Dhaka, Bangladesh - 6:58 am local time
My recent work includes designing ELT pipelines on Azure + Databricks, optimizing Spark workloads to slash processing time, and deploying LLM-based financial sentiment models (e.g., FinBERT) for faster decision-making. I’ve worked with everything from vLLM to GPU-tuned inference runtimes; always with a focus on speed, scalability, and ROI.
I’ve supported both early-stage and enterprise data teams, helping them clean up bloated pipelines, reduce cloud costs, and unlock insights that actually move the needle. If you're dealing with messy pipelines, unclear metrics, or just need to get your analytics stack production-ready, whatever it may be, I can get the job done.
SKILLS:
Azure Data Factory, Databricks, Spark, Snowflake
Python, SQL, PySpark, MLflow
NLP + LLMs for financial insights
API integrations, orchestration, CI/CD
Cloud-native design (Azure Functions, AKS, event-driven compute)
Steps for completing your project
After purchasing the project, send requirements so Shafee Ul Kabir can start the project.
Delivery time starts when Shafee Ul Kabir receives requirements from you.
Shafee Ul Kabir works on your project following the steps below.
Revisions may occur after the delivery date.
Initial Consultation & Requirement Gathering
We’ll start with a detailed call or message exchange to understand your business needs, goals, and current infrastructure.
Solution Design & Architecture
I’ll create a custom solution architecture including the tech stack, data flow diagrams, and integration points, tailored to your use case.