As a Data Engineer, I build and manage robust, end-to-end data systems designed for scalability and real-time performance. My experience covers the full data lifecycle: from automated data scraping and ingestion, through complex batch and stream processing, to the development of custom APIs and customer-facing analytical applications.
I am proficient in cloud-native environments, leveraging containerization and orchestration to create resilient, microservice-based architectures. I focus on writing clean, efficient code and selecting the best technologies to solve complex data challenges in a practical and maintainable way.
Technical Expertise
Data Streaming & Real-Time Processing:
Apache Kafka: Fluent in designing and operating high-throughput streaming platforms, including Confluent Kafka and Kafka Connect (Source/Sink connectors) deployed on Kubernetes.
Apache Flink: Development of stateful, real-time stream processing applications.
Apache Spark: Building and optimizing Spark Structured Streaming pipelines.
Batch Processing & Big Data:
Apache Spark: Extensive experience in large-scale batch ETL processing using PySpark across diverse data sources.
Big Data Ecosystem: Proficient with Databricks, Hadoop, and Apache Hive.
Data Orchestration & Workflow Automation:
Apache Airflow: Designing, scheduling, and monitoring complex DAGs. Specialized experience using the KubernetesPodOperator for scalable, containerized task execution within Rancher-managed clusters.
Apache NiFi: Building and managing automated data flows.
Cloud, Containerization & DevOps:
Cloud Platforms: AWS (S3, Redshift, Glue, Athena), GCP.
Containerization: Docker, containerd.
Orchestration: Kubernetes (K8s), including hands-on experience with minikube and k3s, managed via Rancher.
Architecture: Designing and implementing Microservice Architectures.
CI/CD: Jenkins, GitHub Actions, Git (GitHub, Bitbucket), version control, and branching strategies.
Databases & Data Warehousing:
NoSQL: Cassandra (daily operational use in production clusters), MongoDB, CouchDB.
Analytical (OLAP): ClickHouse, Trino (PrestoSQL), Amazon Redshift.
Relational (SQL): PostgreSQL, MySQL.
Storage & Caching: Redis for application caching layers, MinIO for S3-compatible object storage.
API Development & Embedded Analytics:
API Development: Building performant web services and APIs using FastAPI and Python. Proficient with API testing tools like Postman.
Embedded Analytics: Advanced development with Apache Superset, utilizing its REST API and Security API to build secure, custom shell applications for customer-facing analytics.
Monitoring, Logging & Visualization:
Log Management: Full implementation of the ELK Stack (Elasticsearch, Logstash, Kibana) for log aggregation, analytics, and building monitoring dashboards.
Metrics & Visualization: Grafana, Tableau, Power BI, Apache Superset.
Programming, MLOps & Project Management:
Languages: Python (incl. Pandas, NumPy), SQL, Bash.
MLOps: MLflow for managing the machine learning lifecycle.
Project Management: Atlassian Jira for Agile/Scrum sprint planning and task management.
Data Scraping:
Designing and operating automated data scraping pipelines using Puppeteer, Selenium, Playwright, and FlareSolverr.
Notable Projects
- Reddit Data Pipeline
Developed an automated pipeline for extracting, transforming, and analyzing Reddit data. Leveraged NiFi, MinIO, Trino, and Tableau/Superset for a complete ETL process, enabling dynamic querying and visualization of high-velocity data streams.
- OTP Data Pipeline
Engineered a real-time pipeline for secure OTP generation and notifications, utilizing Kafka, Airflow, Cassandra, and MongoDB. Integrated email and Slack/Discord notifications for streamlined monitoring.
- Yelp Sentiment Analysis
Created a real-time streaming pipeline for Yelp reviews using Spark, Kafka, and Hugging Face’s DistilBERT. Visualized sentiment analysis insights in Kibana, showcasing the integration of machine learning with data engineering.
- ELK Stack Log Management
Set up a secure and scalable multi-node ELK Stack for log analytics, employing index lifecycle policies and creating drill-down dashboards in Kibana.
Certifications and Education
- IBM Data Engineering Specialization (Coursera)
- Apache Kafka, ELK Stack, and NoSQL Databases (BTK Academy)
- Machine Learning Specialization (Stanford, Coursera)
- Data Engineering Nanodegree (Udacity)
Apache Spark
Python
Data Engineering
Apache Airflow
SQL
Apache Kafka
Kubernetes
Apache Cassandra
ETL
FastAPI
Apache Superset
Data Analytics
Data Processing
Data Extraction
ClickHouse
doruk T.
Istanbul, Turkey
$33/hr
5.0
2 jobs
Full-stack software developer with 15+ years' experience, design acumen, and a keen eye for UX and simplicity. Proven track record in getting things done. Specialize in web and mobile apps. Proficient in AWS, G Cloud, React, Java and more. Diverse project background.
Highlighted achievements from my resume include:
1. Spearheaded the development of an EV-charging SaaS platform.
2. Orchestrated the migration of PL/SQL business logic to Spring Boot microservices at Allianz.
3. Pioneered the creation of a cutting-edge eCommerce recommendation system.
4. Elevated customer satisfaction with innovative design on a municipality helpline software.
5. Developed a reputation management web app utilizing G Cloud, Quarkus, Vue.js, and Firebase.
Scala
Prototyping
Basecamp
Design Thinking
Minimum Viable Product
Implementation Plan
Agile Project Management
Java
JavaScript
Web Application
Mobile App
Merve O.
Istanbul, Turkey
$30/hr
5.0
1 jobs
Turn messy, complex data into reliable, scalable, and production-ready systems.
I am a Data Engineer and Architect with over 5 years of experience specializing in the entire data lifecycle. From building real-time streaming architectures to deploying cost-efficient cloud analytics platforms, I bridge the gap between raw data and actionable business value.
With a background in both Data Engineering and Data Science, I don't just move data; I ensure it is modeled for high-performance analytics and predictive insights.
Core Expertise & Services:
• Data Warehouse & Lakehouse Architecture: Custom-designed, scalable solutions using Databricks (Delta Lake), and BigQuery.
• ETL/ELT Pipeline Development: Robust data workflows using Python, SQL, dbt, and Apache Spark.
Real-Time Streaming: High-performance systems utilizing Kafka, Flink, and Spark Streaming (Scala/Python).
• Orchestration & MLOps: End-to-end workflow automation with Apache Airflow; production-grade MLOps pipelines using MLflow for experiment tracking and model lifecycle management; CI/CD pipelines with Jenkins, GitHub Actions, Terraform, and Helm. Real-time change data capture (CDC) architectures with Debezium integrated into Kafka-based systems.
• Infrastructure & DevOps: Production-ready containerization via Docker & Kubernetes across AWS, GCP, and Azure, or specialized on-premises environments.
• Database Migrations: Seamless metadata upgrading and migration for PostgreSQL, MySQL, and NoSQL systems.
• AI Engineering & LLMOps: Building production-ready LLM-based systems, RAG architectures, and vector data modeling integrated with MLflow for scalable AI deployment.
• AI-Driven Automation & Orchestration: Designing and deploying autonomous AI agents and advanced workflow automation using n8n. Expert in bridging LLMs, vector databases, and enterprise data pipelines into production-ready, self-hosted or cloud-based autonomous systems that orchestrate complex business logic.
Technical Stack:
Languages: Python (FastAPI), Scala, SQL.
Big Data Tools: Spark, Trino, Flink, Hadoop, Hive.
Data Ops, MLOps & Automation: Airflow, dbt, n8n (AI Agent Workflows), Kafka, Debezium (CDC), MLflow, Jenkins, CI/CD pipelines.
Cloud: AWS, GCP, Azure, MinIO.
Monitoring & Logging: Elasticsearch, Kibana
Visualization: PowerBI, Tableau, Looker Studio
Proven Impact:
Award-Winning Solutions: Led a freight price estimation project that achieved 78% accuracy, winning the Ministry of Trade Digital Transformation Award.
Cost Efficiency: Reduced annual operational costs by $150K through optimized data architecture and predictive modeling.
Global Collaboration: Extensive experience working with international teams across Europe and Turkiye, combining technical leadership with business strategy.
Whether you need a complete migration to the cloud or a real-time analytics dashboard, I am here to build the engine that powers your growth.
Let's discuss how I can optimize your data infrastructure and unlock valuable insights for your business. Click "Invite to Job" or "Message" to start the conversation!
Tell us what you need. Create your own job post or generate one with AI then filter talent matches.
Hire top talent fast
Consult, interview, and hire quickly, so you can meet the freelancers you're excited about.
Collaborate easily
Use Upwork to chat or video call, share files, and track project progress right from the app.
Payment simplified
Manage payments in one place with flexible billing options. Only pay for approved work, hourly or by milestone.
Don't just take our word for it
“Upwork provides an umbrella-level of security. I can see a talent’s work history and ratings. I can hold payments in escrow. I can communicate through Upwork Messages instead of working through my email address.”
KD
Kim Darling
Emerald Tiger
“Upwork is the best platform to hire skilled professionals when we're not looking for a full-time employee. All the companies in our portfolio use Upwork to find talent across a wide range of fields.”
DM
David Merry
Kinetic Investments
“Our very specific requirements can be a challenge—With Upwork, we’re able to access a bigger community to ensure the success of our projects.”
KK
Katja Krohn
Summa Linguae
How do I hire a Scala Developer in Turkey on Upwork?
You can hire a Scala Developer in Turkey on Upwork in four simple steps:
Create a job post tailored to your Scala Developer project scope. We'll walk you through the process step by step.
Browse top Scala Developer talent on Upwork and invite them to your project.
Once the proposals start flowing in, create a shortlist of top Scala Developer profiles and interview.
Hire the right Scala Developer for your project from Upwork, the world's largest work marketplace.
At Upwork, we believe talent staffing should be easy.
How much does it cost to hire a Scala Developer?
Rates charged by Scala Developers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.
Why hire a Scala Developer in Turkey on Upwork?
As the world's work marketplace, we connect highly-skilled freelance Scala Developers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Scala Developer team you need to succeed.
Can I hire a Scala Developer in Turkey within 24 hours on Upwork?
Depending on availability and the quality of your job post, it's entirely possible to sign up for Upwork and receive Scala Developer proposals within 24 hours of posting a job description.