Hire the Best Data Engineers
in Sri Lanka

A software engineer driven by a deep curiosity for science and mathematics, focused on building software solutions that positively impact society. Combines theory and practice to develop performant, resilient, and user-friendly solutions, with experience from both startups and large-scale companies in multiple domains. Past leadership roles have strengthened team management and task prioritization skills, enabling timely and high-quality delivery.

I am an experienced Business Intelligence Consultant with over 18 years of hands-on expertise in data engineering, data warehousing, and analytics. I design and implement robust enterprise data warehouses, optimize ETL processes, and deliver actionable BI solutions that empower organizations to make smarter decisions. My focus is always on delivering reliable, scalable, and business-aligned outcomes for every project.

You need a product that works — fast, stable, and built to scale. Something users actually want to use, and something your team won’t need to rebuild three months from now. That’s what I deliver. I’m a backend-first full-stack engineer (Python/Django/FastAPI + React) who ships production systems with clean architecture, reliable integrations, and strong performance. Whether you’re launching a new SaaS, hardening an existing platform, or integrating AI into your workflow, the goal is the same: build something maintainable that drives real business results. Most clients come to me mid-chaos: slow dev cycles, unstable features, messy codebases, missed deadlines. I step in, simplify the scope, stabilize the core, and get you shipping with confidence. I care about quality: tests where it matters, clear PRs, documented decisions, and systems that don’t fall apart under real usage. I also build practical AI features (RAG, agents, automation) the right way — structured outputs, guardrails, logging, retries, and cost controls — so it behaves predictably in production, not just in demos. This isn’t freelance roulette. You’re hiring someone who can think, build, and deliver — without hand-holding. If you want a dependable partner who moves fast and builds correctly, let’s talk. ✅ Expertise • Backend & APIs (Python, Django/DRF, FastAPI) • Full-stack delivery (React/Next.js) • AI integrations (OpenAI/Claude, RAG, agents, automation) • Cloud & DevOps (AWS, Docker, CI/CD, Serverless) • Data engineering (ETL, pipelines, PostgreSQL) • Testing, QA mindset, and documentation I prefer this response You get clean code, clear architecture & systems you own—not vendor lock-in. ✅ Free 40-min consultation ✅ Early working slice to prove value (win–win) 💬 Tell me what you want your agent/system to do—and I’ll show you how we make it real.

⭐⭐⭐⭐⭐ “Our services ran 10x faster after Shafir’s optimization. He’s a genius!” — Paul S., Schoop Ltd 📣 With over 11 years of professional experience, I am a skilled SQL Server freelancer on Upwork, specializing in SQL Server DBA, database development, and business intelligence development (Data Engineer). 🎯 I've successfully resolved customer-facing SQL Server bottlenecks and achieved significant performance enhancements for Fortune companies and renowned organizations, including the following to illustrate some of them: ☑️ AAA Communication Inc. USA (~14 Million Estimated Revenue per Year) ☑️ NeTex Consulting. USA ☑️ Cloud Retailer. USA (Over 1 Million Invested on Upwork) ☑️ Selectel Wireless. USA ☑️ Jevin Inc. USA ☑️ Boender & BeuteI GmbH, Germany ☑️ Access IT, USA Extensive Experience as a SQL Server DBA (Versions 2000 - 2022) methodically identifying and resolving complex underlying causes of Microsoft SQL Server problems, using a vast variety of techniques and tools. I have solved numerous show-stopping SQL Server Performance problems, as well as often re-engineered immensely complex designs and code, providing significantly improved performance. Expert Level ability with Data Extraction, Transformation, and Loading (ETL) from numerous heterogeneous data sources. I pride myself in my ability to intuitively gather, interpret and understand your requirements, as well as develop intuitive and creative Business Intelligence Solutions using the full MSBI stack (Power BI, SSAS, SSRS, and SSIS). ⭐ Here's what I can offer to your project ⭐ ✔️ Top-notch experience in utilizing SQL Server across all versions from 2000 to 2022, as well as on various cloud platforms. ✔️ Extensive experience in SQL Server database corruption repair and recovery. ✔️ Extensive experience handling large-scale enterprise transactional databases. ✔️ Expertise in data security best practices, particularly regarding PII and PHI data. ✔️ Proficient in swiftly diagnosing SQL performance issues and pinpointing query bottlenecks. ✔️ Expertise in ETL development using SSIS for data warehouses and Power BI databases. ✔️ 24/7 reliable communication: keeping you constantly informed of project status. ✔️ A dedicated professional committed to your success and adding value to your business. ⭐ Why I stand out from other freelancers. ⭐ ✔️ Client Reviews: My priority is delivering value and building trust with every client. ✔️ Over-Delivering: This principle is central to my freelance work. I aim to exceed expectations and take pride in leaving clients saying "WOW" ✔️ Responsiveness: Highly responsive, ensuring all lines of communication are always open with my clients. ✔️ Resilience: Reach out to any of my current or former clients and inquire about my ability to tackle challenges head-on and find effective solutions for any issue they face. ✔️ Kindness: A core value that permeates every aspect of my life. I treat everyone with respect, approach all situations with empathy, and genuinely strive to enhance my clients' experiences. 🏆 Testimonials and feedback from prominent clients🏆 The client reviews below, also featured in my work history section, highlight the quality of work and value you can expect when working with me. ⭐⭐⭐⭐⭐"I hired Shafir to repair a corrupted SQL database. We used 2 other SQL engineers prior to meeting Shafir and also attempted a repair using a database repair application which also failed. We were at a point where nothing was working and we were coming to the conclusion that this was not repairable as there were too many errors. Shafir was very confident that he could repair the database and after watching him work for just a few minutes I immediately felt some hope of a successful repair. After working on the database for several hours Shafir managed to repair the database and get it working better than it was before. Working 20 years in IT I had never seen anything like it. Shafir is very professional and truly an SQL expert. I would highly recommend Shafir for any SQL project. Thank you." - Dean Cutajar, Director - Access IT ⭐⭐⭐⭐⭐ "Amazing experience! Shafir did the impossible. He was able to take a highly corrupted database and bring it back to life with zero data loss. Once repaired, he optimized the database and has it running better than it was before the corruption. He is responsive and easy to work with. Highly recommended. Will use again in the future." Jeff Cross 303 Networks Inc 🙋🏼♂️I am eager to work with you, to provide reliable, consistent, and High-Level solutions to design/development challenges. Please contact me, so we can discuss how we can work together to FULLY meet your Business Needs!

I am a Data Engineer with hands-on experience designing, building, and maintaining scalable data pipelines across both Azure and AWS environments. I specialize in developing end-to-end ETL/ELT solutions using tools such as Azure Data Factory, Databricks, AWS Lambda, S3, Redshift, Airflow, and Snowflake. I have worked extensively with data from ERP systems, databases, APIs, and structured and semi-structured formats, including JSON and XML. My experience includes data extraction from systems such as SAP, data transformation using PySpark and SQL, and modeling for analytics and reporting using modern data warehouse and lakehouse architectures. I am comfortable handling data cleansing, validation, aggregation, and enrichment, as well as implementing Slowly Changing Dimensions (SCD) to maintain accurate historical data. I also have experience setting up CI/CD pipelines, monitoring workflows with tools such as Grafana and Splunk, and optimizing performance for large-scale data processing. Whether the requirement is cloud migration, building reliable batch or real-time data pipelines, or supporting analytics and machine learning use cases, I focus on delivering robust, maintainable, and business-ready data solutions.

Specialize in designing and implementing data pipelines, machine learning workflows, and deploying models into production, while managing end-to-end projects to deliver real business value. Throughout my journey, I’ve taken on roles as a Data Engineer, Machine Learning Engineer, Data Scientist, and Project Manager, allowing me to understand and contribute across the full data lifecycle from raw data to real-time decision-making. Outside of full-time work, I’m passionate about technical writing breaking down complex AI and data topics into content that’s easy to understand and valuable for others. I also enjoy mentoring and experimenting with new project ideas that solve real-world problems and scale effectively.