You will get end to end data engineering pipelines using cloud (Aws-Azure)
Project details
You will get scalable, reliable, and performance-optimized data solutions designed to turn raw data into actionable insights. With hands-on experience in data engineering projects and real-world industry exposure, I specialize in building end-to-end data pipelines using tools like Apache Spark, Airflow, SQL, and cloud platforms. I care deeply about data quality, automation, and efficiency, ensuring every solution I deliver is robust, secure, and production-ready. All work is custom-built, well-documented, and aligned with modern data engineering best practices.
Data Tool
SQLWhat's included
| Service Tiers |
Starter
$10
|
Standard
$20
|
Advanced
$50
|
|---|---|---|---|
| Delivery Time | 2 days | 5 days | 10 days |
Number of Revisions | 0 | 1 | 2 |
Data Source Connectivity | - | - | - |
Web Embedding | - | - | - |
Interactive/Animated Visuals | - | - | - |
About Abdul Basit
Cloud Data Engineer | Azure | AWS | SQL | Python
Sukkur, Pakistan - 2:17 am local time
I design and build data pipelines on Azure and AWS, the kind that keep running quietly long after I've moved on to the next project. I've got four end-to-end pipelines documented on my GitHub, covering everything from raw ingestion through medallion-layer transformation to warehouse tables that are actually ready for reporting.
I'm new to Upwork, but not new to this work. I picked up the Azure stack during a data engineering internship at Systems Limited, and I've kept building on it since, I'm currently working through Microsoft's DP-700 certification for Fabric, and I already hold certifications in Databricks Lakehouse Fundamentals and AWS.
Here's what that looks like in practice:
Services I offer:
Data pipeline development (ETL/ELT), moving data from source systems into a warehouse, reliably and on schedule
Cloud data warehousing, structuring data in Azure Synapse and Microsoft Fabric (Lakehouse/Warehouse) so it's actually usable
SQL development & optimization, writing and tuning queries, stored procedures, and schemas that hold up at scale
Workflow orchestration, automating pipelines with Apache Airflow so jobs run on their own
Data cleaning & integration, merging and standardizing data from multiple, messy sources into one reliable dataset
Database design, schemas and ERDs built to scale past the demo
Web scraping. pulling structured data from static or JavaScript-heavy sites with BeautifulSoup and Selenium
Tech stack:
Cloud & platforms: Azure (Data Factory, Synapse Analytics, Data Lake, Microsoft Fabric), Databricks, AWS
Languages: Python (Pandas, NumPy, BeautifulSoup, Selenium, psycopg2), SQL, T-SQL, Spark SQL
Databases: PostgreSQL, MySQL, Azure SQL
Orchestration: Apache Airflow
Design tools: DrawIO, LucidChart, pgAdmin ERD Tool
OS: Linux (Ubuntu)
If you've got a pipeline that needs building from scratch, one that's quietly breaking, or data that's currently a mess, send a message. I'll tell you plainly whether I'm the right fit, and if I'm not, I'll say so before you spend a Connect finding out.
Steps for completing your project
After purchasing the project, send requirements so Abdul Basit can start the project.
Delivery time starts when Abdul Basit receives requirements from you.
Abdul Basit works on your project following the steps below.
Revisions may occur after the delivery date.
detailed discussion before project execution