Upwork home
Sign up
Project Catalog
DesignDesign
Video & AudioVideo & Audio
Development & ITDevelopment & IT
MarketingMarketing
Writing & TranslationWriting & Translation
MoreMore

You will get Automated ETL pipeline using Apache Airflow with full monitoring

Malak S.Status: Offline
Malak S.
Preview imagePreview imagePreview imagePreview image

Let a pro handle the details

Buy Other Databases services from Malak, priced and ready to go.
Malak S.Status: Offline
Malak S.
Preview imagePreview imagePreview imagePreview image

Let a pro handle the details

Buy Other Databases services from Malak, priced and ready to go.

Project details

I developed an Apache Airflow project that demonstrates how to design and run automated data pipelines. The project includes:

Task Scheduling: DAGs scheduled to run daily.

Data Extraction: Shell commands and Python tasks to fetch data.

Transformation: Custom Python functions to process raw data.

Loading: Save processed output into files (CSV/JSON) for downstream use.

Monitoring: Graph view and task logs in the Airflow UI for full observability.

The solution runs inside a reproducible environment (GitHub Codespaces / Docker) with Airflow configured, making it easy to deploy and extend.
Database Type
MySQL, MS SQL, SQLite, PostgreSQL, MongoDB, Azure Cosmos DB
What's included
Service Tiers Starter
$20
Standard
$50
Advanced
$120
Delivery Time 2 days 4 days 7 days
Number of Revisions
123
Source Code
-
Optional add-ons You can add these on the next page.
Additional Revision
+$5
powerbi (+ 1 Day)
+$20
Malak S.Status: Offline

About Malak

Malak S.Status: Offline
Data engineer
Giza, Egypt - 1:51 pm local time
I’m a passionate Data Engineer with hands-on experience in designing data pipelines, managing databases, and building reporting systems using Python and SQL Server. I help businesses turn raw data into clean, structured, and actionable insights.

What I Can Do for You

Build ETL pipelines with Python (extracting from CSV, Excel, APIs, or databases, cleaning, and loading into SQL Server).

Design and implement databases & data warehouses (fact & dimension tables, star/snowflake schema).

Develop automation scripts in Python for data cleaning, validation, and transformation.

Optimize SQL queries, stored procedures, and database performance.

Create dashboards & reports by connecting SQL Server with BI tools (Power BI).

Perform data analysis & business insights (sales, HR, finance, customer behavior).

Handle data migration projects from Excel/legacy systems into SQL Server.

Steps for completing your project

After purchasing the project, send requirements so Malak can start the project.

Delivery time starts when Malak receives requirements from you.

Malak works on your project following the steps below.

Revisions may occur after the delivery date.

Requirement Gathering

Collect details about data sources, credentials, KPIs, and reporting needs. Agree on schedule (daily, weekly, etc.) and output format.

Environment Setup

Configure Apache Airflow environment. Create a project structure and DAGs folder

Review the work, release payment, and leave feedback to Malak.