You will get Data Engineering: Legacy Data Migration & Modernization
Top Rated
Project details
Data Engineering: You will get seamless legacy data migration to modern cloud platforms such as Snowflake, Databricks, or BigQuery. As an experienced Data Engineer, I specialize in data engineering, ETL pipeline development, and database design to modernize outdated systems and ensure smooth transitions. Using Python and Airflow orchestration, I unify data from APIs, flat files, and legacy databases into a scalable data warehouse.
As a Data Engineer, I design migration projects with data modeling, validation, and cleaning to guarantee quality and reliability. Each pipeline is automated with monitoring and error handling to reduce risks and improve efficiency. Integrated with Power BI or Tableau, the solution delivers accurate reporting, actionable analytics, and faster decision-making.
With proven expertise as a Data Engineer in Python, SQL, and enterprise-grade data engineering, I deliver production-ready solutions that are reliable and future-proof. My approach as a Data Engineer combines automated ETL pipelines, optimized data warehousing, and cloud-native practices, creating a trusted infrastructure that supports compliance, advanced analytics, and long-term growth.
As a Data Engineer, I design migration projects with data modeling, validation, and cleaning to guarantee quality and reliability. Each pipeline is automated with monitoring and error handling to reduce risks and improve efficiency. Integrated with Power BI or Tableau, the solution delivers accurate reporting, actionable analytics, and faster decision-making.
With proven expertise as a Data Engineer in Python, SQL, and enterprise-grade data engineering, I deliver production-ready solutions that are reliable and future-proof. My approach as a Data Engineer combines automated ETL pipelines, optimized data warehousing, and cloud-native practices, creating a trusted infrastructure that supports compliance, advanced analytics, and long-term growth.
Database Type
MySQL, MS SQL, MS Access, SQLite, PostgreSQL, MongoDB, Teradata, LevelDBWhat's included $10,000
These options are included with the project scope.
$10,000
- Delivery Time 20 days
- Number of Revisions 1
7 reviews
(7)
(0)
(0)
(0)
(0)
This project doesn't have any reviews.
AG
Anna G.
Nov 4, 2025
Senior Data Engineer – ETL Pipelines & Snowflake Data Warehouse
Great collaboration overall. Strong expertise in building and optimizing ETL pipelines for Snowflake. Communication was clear and proactive, all deliverables were well-documented and delivered on time. Would definitely recommend.
MC
Moiead C.
Apr 21, 2025
RPA Engineer - Contractor
EK
Emil K.
Nov 10, 2021
QR code Photo Booth
Freelancer has been attentive to our needs and wishes during the process and has given valuable input themselves to help create a better product.
CL
CJ L.
Jul 20, 2021
Scrape multiple websites and dedupe + verify data
BWT has been a joy to work with. From scoping to kickoff, rounds of feedback, and final delivery, they've been patient, thorough, and an overall pleasure to work with. I would highly recommend working with them and they are going to be on my shortlist long-term.
SD
Suresh D.
Feb 26, 2021
Looking for an experienced Python developer with primary focus on web scraping.
About Oleg
Python Data Engineer | Data Visualization Expert
100%
Job Success
Zaporizhzhia, Ukraine - 7:52 am local time
I architect scalable ETL/ELT pipelines and transform complex, multi-source data into reliable, executive-ready dashboards.
Here’s how we support our clients:
✅ Our ETL pipelines process over 100 million records monthly across major cloud data warehouses
✅ My solutions reduce manual reporting effort by up to 80% through end-to-end automation
✅ We build Python-powered workflows for integrating, cleaning, and modeling complex datasets
✅ Every pipeline is tested and quality-checked to meet enterprise data standards
🔁 What I Do
⚙️Data Engineering
🔹API & event-based ingestion
🔹Python + SQL transformations
🔹Data modeling, schema design, enrichment
🔹ETL/ELT into Snowflake, Databricks, BigQuery
🔹Monitoring, retries, observability & data quality testing
🔹CI/CD for pipelines & cost optimization in cloud
Platforms I’ve delivered process 100M+ records/month, integrate 30-80+ APIs, and power real-time BI environments.
📊 Data Visualization & BI
🔹I bridge raw data with business decisions
🔹Power BI, Looker Studio & Tableau dashboards
🔹Executive KPI reporting
🔹Semantic layer & metric standardization
🔹Real-time reporting (<5 min latency)
🔹BI performance optimization
🔹Data storytelling for leadership & operations
My solutions reduce manual reporting effort by up to 70-80% and significantly improve forecasting accuracy.
🧩 Recent Experience
🔹Retail & eCommerce Data Warehousing
Built ingestion + normalization pipelines for 120+ eCommerce sources, syncing ~500K SKUs/day into Snowflake / BigQuery. Implemented product matching, deduplication, schema standardization, and incremental updates to keep analytics tables stable for BI.
🔹FinTech Ingestion & Reporting Layer
Delivered an automated pipeline that pulls data from 30+ external/internal sources (APIs, DBs, files), applies validation rules and transformations, and loads curated datasets for financial reporting and near-real-time dashboards. Focus on accuracy, auditability, and consistent metric definitions.
🔹Government ETL & Document Processing
Automated processing of 10K+ documents/day (PDFs + structured files): extraction, classification, field mapping, and loading into a unified database. Added monitoring, error handling, and QA checks so ops teams don’t manually reconcile data.
🔹Healthcare Data Normalization & Compliance
Cleaned and standardized millions of records across fragmented healthcare datasets: schema mapping, PII-aware handling, validation, and reproducible transformations. Produced “analytics-ready” layers with clear lineage and quality controls for compliance-driven reporting.
🔹Large-scale Cloud Migrations
Migrated legacy reporting from MSSQL + Excel into BigQuery/Snowflake: rebuilt data models, implemented incremental loads, replaced spreadsheet-based workflows with automated pipelines, and delivered dashboards that refresh on schedule.
💻 Tech Stack
⚙️Languages: Python, SQL, DAX, Power Query, PySpark, Scala, Bash/Shell, JavaScript, etc.
⚙️Data Engineering & Processing: PySpark, dbt, Airflow, Prefect, CDC, REST & GraphQL, etc.
⚙️Data Warehouses & Databases: Snowflake, Databricks, BigQuery, AWS, PostgreSQL, MSSQL
⚙️Cloud Platforms: AWS: S3, Glue, Lambda, CloudWatch, Athena, Redshift, BigQuery, Dataflow
⚙️Data Modeling & Architecture: Star schema, Snowflake schema, Lakehouse architecture, etc.
⚙️Monitoring & Data Quality: dbt, Prometheus, Grafana, AWS CloudWatch, GCP Monitoring, etc.
⚙️BI & Visualization: Power BI (Desktop, Service), Tableau, Looker Studio, Metabase, etc.
⚙️DevOps & CI/CD: Git, GitHub, GitLab CI, Docker, Terraform, etc.
🚀 If you need automated pipelines, clean data models, and executive-level dashboards - let’s connect.
➡️ Invite me to your job and let’s design a robust data strategy with a Data Engineer leading the way.
Last updated February 17, 2025
Steps for completing your project
After purchasing the project, send requirements so Oleg can start the project.
Delivery time starts when Oleg receives requirements from you.
Oleg works on your project following the steps below.
Revisions may occur after the delivery date.
Legacy System & Data Audit
Analyze legacy databases, flat files, and APIs to plan migration scope, risks, and modernization strategy.
Migration Architecture Design
As a Data Engineer, create architecture for data migration, ETL pipelines, and cloud data warehouse setup.