You will get Enterprise ETL Pipeline, Semantic SQL RAG System & Role-Based Web Portal
Top Rated
Project details
This project involved designing and building a complete data & intelligence ecosystem for a client covering Accounting, Manufacturing, Purchasing, SQL automation, and internal reporting workflows. The goal was to create a fully automated ETL pipeline, ensure schema consistency across environments, generate SQL using AI (RAG + LLMs), and provide a secure RBAC-enabled web application for end-users and management teams.
The work combined three major pillars:
1. A production-grade ETL pipeline (Airflow + PostgreSQL + Python)
2. A Semantic SQL Generation system using RAG, Qwen 72B, Qdrant, and Amazon RDS
3. A complete Role-Based Access Control (RBAC) web portal with Power BI embedding
The result is a stable, automated, and scalable ecosystem where:
• ETL pipelines run daily without manual intervention
• Schemas automatically update when source structures change
• Business users query the database in plain English
• Reports refresh reliably through Power BI gateway integration
• Admins can manage users, roles, and reports from a central web portal
The work combined three major pillars:
1. A production-grade ETL pipeline (Airflow + PostgreSQL + Python)
2. A Semantic SQL Generation system using RAG, Qwen 72B, Qdrant, and Amazon RDS
3. A complete Role-Based Access Control (RBAC) web portal with Power BI embedding
The result is a stable, automated, and scalable ecosystem where:
• ETL pipelines run daily without manual intervention
• Schemas automatically update when source structures change
• Business users query the database in plain English
• Reports refresh reliably through Power BI gateway integration
• Admins can manage users, roles, and reports from a central web portal
Programming Languages
HTML & CSS, JavaScript, PythonCoding Expertise
Cross Browser & Device Compatibility, Performance OptimizationWhat's included
| Service Tiers |
Starter
$3,600
|
Standard
$4,200
|
Advanced
$5,000
|
|---|---|---|---|
| Delivery Time | 25 days | 30 days | 35 days |
Number of Revisions | 2 | 3 | 3 |
Design Customization | |||
Content Upload | |||
Responsive Design | |||
Source Code |
6 reviews
(6)
(0)
(0)
(0)
(0)
This project doesn't have any reviews.
JA
Jassy A.
May 4, 2026
Database Architect / RDS Engineer (Healthcare)
CT
Clara T.
Mar 24, 2026
Senior Data Engineer – Logistics Data Automation & Validation
Great freelancer, highly recommended!
MW
Michael W.
Mar 17, 2026
Google Analytics and Looker Dashboard Specialist
Faisal is a great contractor to work with. I have worked with him twice now and will certainly work with him again. He is detailed and wants to ensure his clients are happy with his work. He is very knowledgeable and is committed to a successful outcome for all his projects/contracts.
KW
Kasper W.
Feb 17, 2026
Data Engineering
Fantastic work. On time and within budget. Quality was also great. Would highly recommend
MW
Michael W.
Dec 8, 2025
Google Analytics and Looker Dashboard Specialist
Faisal is a great contractor and I will definitely work with him again. He delivered our project exactly as promised.
About Faisal
Data Engineer | AWS | ETL Pipelines | AI Automation | RAG
100%
Job Success
Rahim Yar Khan, Pakistan - 1:48 am local time
I help businesses build scalable data pipelines and AI-powered systems that improve decision-making, reduce costs, and automate workflows.
With 6+ years of experience as a Data Engineer and growing expertise in Generative AI, I design cloud-native data architectures and enhance them with AI-driven automation, insights, and intelligent workflows.
Whether you're building from scratch, scaling your data systems, or looking to integrate AI into your operations, I deliver production-ready solutions that actually drive results.
⭐ 𝐂𝐨𝐦𝐩𝐚𝐧𝐢𝐞𝐬 𝐈'𝐯𝐞 𝐖𝐨𝐫𝐤𝐞𝐝 𝐖𝐢𝐭𝐡:
🔹Fintech Startup processing millions of transactions/month across the U.S.
🔹Global B2B SaaS Platform with data operations across 20+ countries
🔹EU Healthcare Analytics Provider working with sensitive PHI data
🔹Manufacturing Firm automating cross-platform data flows for ERP & MES
🔹Multiple Fortune-level enterprises through agency partnerships
⭐ 𝐖𝐡𝐚𝐭 𝐈 𝐁𝐫𝐢𝐧𝐠 𝐭𝐨 𝐘𝐨𝐮𝐫 𝐃𝐚𝐭𝐚 𝐄𝐧𝐠𝐢𝐧𝐞𝐞𝐫𝐢𝐧𝐠 𝐏𝐫𝐨𝐣𝐞𝐜𝐭:
• ETL/ELT Expertise: Airflow, AWS Glue, SSIS, custom orchestration
• Data Warehousing: Snowflake, Redshift, BigQuery, SQL Server, PostgreSQL
• AWS Proficiency: Lambda, Step Functions, RDS, DynamoDB, S3, CloudFormation, Terraform
•Programming: Python (pandas, boto3), SQL, Shell scripting
• Automation & Integration: API ingestion, serverless workflows, CI/CD pipelines
• BI & Analytics: Power BI, Tableau, QuickSight, Looker
• Best Practices: Version control, unit testing, GitOps, Dockerized environments
• Security & Compliance: Handling of PII/PHI, audit-ready pipelines
⭐𝐆𝐞𝐧𝐞𝐫𝐚𝐭𝐢𝐯𝐞 𝐀𝐈 𝗧𝗲𝗰𝗵 𝗦𝘁𝗮𝗰𝗸 & 𝗦𝗸𝗶𝗹𝗹𝘀:
• Languages & Frameworks: Python, Django, FastAPI, React,Next, Streamlit
• AI/LLM Tools: OpenAI API, LangChain, Langgraph, MCP, Anthropic, ElevenLabs, Whisper
• Automation & Infra: RAG pipelines, multi-agent frameworks, workflow orchestration, AWS, Azure
• Integrations: CRMs, ERPs, Firebase, Slack, MS Teams, custom APIs
• ML&DL (Tensoflow,PyTorch)
• NLP
• Large Language Models (LLMs)
• Prompt Engineering
• GANs
• QueryGeneration (GenQ)
• GPL for semantic search
• LangChain
⭐ 𝐖𝐡𝐲 𝐖𝐨𝐫𝐤 𝐖𝐢𝐭𝐡 𝐌𝐞?
🔹Client-Focused Delivery: I prioritize measurable impact and long-term value
🔹Clear Communication: Frequent updates, transparent planning, and no surprises
🔹Trusted Partner: Many clients return for new projects or refer others
𝗔𝗯𝗼𝘂𝘁 𝗺𝘆 𝗰𝗼𝗺𝗽𝗮𝗻𝘆:
DotLabs is an Data engineering & AI-first development company specializing in Generative AI, automation, and domain-specific AI applications. With expertise in Python, JavaScript, AI frameworks, and cloud deployment, we deliver end-to-end, production-ready web and mobile solutions that turn AI innovation into real business impact.
Let’s build a system that not only handles your data, but uses AI to make it smarter.
Send me a message and let’s discuss your project.
Data Engineering, AWS, ETL Pipelines, AI Automation, LLM, RAG, Chatbots
Steps for completing your project
After purchasing the project, send requirements so Faisal can start the project.
Delivery time starts when Faisal receives requirements from you.
Faisal works on your project following the steps below.
Revisions may occur after the delivery date.
Enterprise ETL Pipeline (Accounting, Manufacturing, Purchasing)
We built a multi-layer ETL architecture with Landing Zone → Stage → Prod layers.