You will get Data Engineering: Cloud Data Migration & Strategy
Top Rated
Project details
Data Engineering: You will get a complete end-to-end ETL pipeline and data warehouse solution, built with Python and automated by Airflow orchestration. As an experienced Data Engineer, I specialize in data engineering, including data preprocessing, integration, database design, and data modeling, ensuring pipelines are optimized for scalability and performance.
As a Data Engineer, I work with cloud platforms such as Snowflake, Databricks, and BigQuery, delivering seamless data migration, reliable API integration, and a long-term data engineering strategy for your business. My approach as a Data Engineer combines automated ETL pipelines, modern practices, and robust warehouse design to unify data sources into a future-proof system that grows with your organization.
The result: enterprise-grade data engineering workflows that connect directly to Power BI and Tableau, enabling clear, actionable insights and advanced analytics. With proven expertise as a Data Engineer in Python, SQL, and large-scale ETL development, I deliver production-ready solutions that keep your data warehouse accurate, consistent, and aligned with reporting and analytics needs.
As a Data Engineer, I work with cloud platforms such as Snowflake, Databricks, and BigQuery, delivering seamless data migration, reliable API integration, and a long-term data engineering strategy for your business. My approach as a Data Engineer combines automated ETL pipelines, modern practices, and robust warehouse design to unify data sources into a future-proof system that grows with your organization.
The result: enterprise-grade data engineering workflows that connect directly to Power BI and Tableau, enabling clear, actionable insights and advanced analytics. With proven expertise as a Data Engineer in Python, SQL, and large-scale ETL development, I deliver production-ready solutions that keep your data warehouse accurate, consistent, and aligned with reporting and analytics needs.
Database Type
MySQL, MS SQL, MS Access, SQLite, PostgreSQL, MongoDB, Teradata, LevelDBWhat's included $10,000
These options are included with the project scope.
$10,000
- Delivery Time 20 days
- Number of Revisions 1
7 reviews
(7)
(0)
(0)
(0)
(0)
This project doesn't have any reviews.
AG
Anna G.
Nov 4, 2025
Senior Data Engineer – ETL Pipelines & Snowflake Data Warehouse
Great collaboration overall. Strong expertise in building and optimizing ETL pipelines for Snowflake. Communication was clear and proactive, all deliverables were well-documented and delivered on time. Would definitely recommend.
MC
Moiead C.
Apr 21, 2025
RPA Engineer - Contractor
EK
Emil K.
Nov 10, 2021
QR code Photo Booth
Freelancer has been attentive to our needs and wishes during the process and has given valuable input themselves to help create a better product.
CL
CJ L.
Jul 20, 2021
Scrape multiple websites and dedupe + verify data
BWT has been a joy to work with. From scoping to kickoff, rounds of feedback, and final delivery, they've been patient, thorough, and an overall pleasure to work with. I would highly recommend working with them and they are going to be on my shortlist long-term.
SD
Suresh D.
Feb 26, 2021
Looking for an experienced Python developer with primary focus on web scraping.
About Oleg
Python Data Engineer | Data Visualization Expert
100%
Job Success
Zaporizhzhia, Ukraine - 8:12 am local time
I architect scalable ETL/ELT pipelines and transform complex, multi-source data into reliable, executive-ready dashboards.
Here’s how we support our clients:
✅ Our ETL pipelines process over 100 million records monthly across major cloud data warehouses
✅ My solutions reduce manual reporting effort by up to 80% through end-to-end automation
✅ We build Python-powered workflows for integrating, cleaning, and modeling complex datasets
✅ Every pipeline is tested and quality-checked to meet enterprise data standards
🔁 What I Do
⚙️Data Engineering
🔹API & event-based ingestion
🔹Python + SQL transformations
🔹Data modeling, schema design, enrichment
🔹ETL/ELT into Snowflake, Databricks, BigQuery
🔹Monitoring, retries, observability & data quality testing
🔹CI/CD for pipelines & cost optimization in cloud
Platforms I’ve delivered process 100M+ records/month, integrate 30-80+ APIs, and power real-time BI environments.
📊 Data Visualization & BI
🔹I bridge raw data with business decisions
🔹Power BI, Looker Studio & Tableau dashboards
🔹Executive KPI reporting
🔹Semantic layer & metric standardization
🔹Real-time reporting (<5 min latency)
🔹BI performance optimization
🔹Data storytelling for leadership & operations
My solutions reduce manual reporting effort by up to 70-80% and significantly improve forecasting accuracy.
🧩 Recent Experience
🔹Retail & eCommerce Data Warehousing
Built ingestion + normalization pipelines for 120+ eCommerce sources, syncing ~500K SKUs/day into Snowflake / BigQuery. Implemented product matching, deduplication, schema standardization, and incremental updates to keep analytics tables stable for BI.
🔹FinTech Ingestion & Reporting Layer
Delivered an automated pipeline that pulls data from 30+ external/internal sources (APIs, DBs, files), applies validation rules and transformations, and loads curated datasets for financial reporting and near-real-time dashboards. Focus on accuracy, auditability, and consistent metric definitions.
🔹Government ETL & Document Processing
Automated processing of 10K+ documents/day (PDFs + structured files): extraction, classification, field mapping, and loading into a unified database. Added monitoring, error handling, and QA checks so ops teams don’t manually reconcile data.
🔹Healthcare Data Normalization & Compliance
Cleaned and standardized millions of records across fragmented healthcare datasets: schema mapping, PII-aware handling, validation, and reproducible transformations. Produced “analytics-ready” layers with clear lineage and quality controls for compliance-driven reporting.
🔹Large-scale Cloud Migrations
Migrated legacy reporting from MSSQL + Excel into BigQuery/Snowflake: rebuilt data models, implemented incremental loads, replaced spreadsheet-based workflows with automated pipelines, and delivered dashboards that refresh on schedule.
💻 Tech Stack
⚙️Languages: Python, SQL, DAX, Power Query, PySpark, Scala, Bash/Shell, JavaScript, etc.
⚙️Data Engineering & Processing: PySpark, dbt, Airflow, Prefect, CDC, REST & GraphQL, etc.
⚙️Data Warehouses & Databases: Snowflake, Databricks, BigQuery, AWS, PostgreSQL, MSSQL
⚙️Cloud Platforms: AWS: S3, Glue, Lambda, CloudWatch, Athena, Redshift, BigQuery, Dataflow
⚙️Data Modeling & Architecture: Star schema, Snowflake schema, Lakehouse architecture, etc.
⚙️Monitoring & Data Quality: dbt, Prometheus, Grafana, AWS CloudWatch, GCP Monitoring, etc.
⚙️BI & Visualization: Power BI (Desktop, Service), Tableau, Looker Studio, Metabase, etc.
⚙️DevOps & CI/CD: Git, GitHub, GitLab CI, Docker, Terraform, etc.
🚀 If you need automated pipelines, clean data models, and executive-level dashboards - let’s connect.
➡️ Invite me to your job and let’s design a robust data strategy with a Data Engineer leading the way.
Last updated February 17, 2025
Steps for completing your project
After purchasing the project, send requirements so Oleg can start the project.
Delivery time starts when Oleg receives requirements from you.
Oleg works on your project following the steps below.
Revisions may occur after the delivery date.
Requirements & Data Study
Analyze your data sources, formats, and business needs to define ETL scope, migration plan, and success criteria.
Architecture & Data Strategy
Design scalable architecture for ETL pipelines, cloud data warehouse, and integration flow tailored to your goals.