Hire the Best Data Engineers
in Indonesia

I help businesses collect, organize, and automate data at scale. My work focuses on building reliable data pipelines that transform information from websites, APIs, documents, and online platforms into structured datasets ready for business use. Over the years, I have developed web scraping systems, ETL workflows, automation tools, and PostgreSQL-based data solutions for real estate, ecommerce, lead generation, market research, and business intelligence projects. What I can help you with: • Web Scraping & Data Extraction • Python Automation • ETL Pipeline Development • PostgreSQL Database Integration • API Integration • Data Cleaning & Transformation • Workflow Automation (n8n, Python) • AI-Assisted Data Processing • Excel, CSV & Database Delivery Tools & Technologies: Python, Playwright, Selenium, Scrapy, BeautifulSoup, PostgreSQL, REST APIs, n8n, Pandas, SQL I focus on building solutions that are reliable, maintainable, and scalable — not just one-time scripts.

Hello! 👋 My name is Muhammad Amin, I am from Indonesia. I am a web developer and data engineer with over 7 years of experience. I have a diverse skill set that includes proficiency in Python, PHP Codeigniter, and Node.js, as well as expertise in cloud platforms like GCP, Azure, and AWS. Beyond my professional experience, I have a strong foundation in data science and machine learning, which I've developed through various online courses and certifications from platforms such as Datacamp, Coursera, and Dicoding. I'm passionate about learning and continuously improving my skills in these fields. Feel free to check out my GitHub portfolio to see some of my work! I'm always happy to connect, so don't hesitate to reach out if you have any questions or just want to chat. 😊 Github: amien1410

#Data Engineer ( Python, NodeJS, Shell, NoSQL, JSON) #BigData Environment (Hadoop, Kafka, Hive, Spark etc) #Data Pipeline and WorkFlow ( Airflow, Kedro, Luigi, Talend) #Web Appllication Developer ( PHP, React JS, Laravel) #CloudPlatform ( AliCloud & GoogleCloudPlatform) #HRIS Expert #HR Management #CRM ( SalesForce) #Cloud ServerLess using Fun Aliyun - AlibabaCloud #Python for Serverless As Data Engineer, My job description is create and maintain optimal data pipeline architecture. Assemble large, complex data sets that meet functional / non-functional business requirements. Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using NoSQL and AliCloud ‘big data’ technologies ( Data Work as Datawarehouse, ApsaraDB for MongoDB, Max Compute and Object Storage Services(OSS) as Supporting, Build API Services using Function Compute with Docker Services. Another Platform ever used : DataVirtuality as a pipeline, Supermetrics as another supporting pipeline, Talkwalker as social Media Listener, BigQuery - Google Cloud Platform as a Datawarehouse and Tableau as Analytics side CRM Platform : Sales Force Marketing Cloud ( Administrator Role) Datawarehouse development using postgreeSQL for MAP Ecommerce Channel Project ( Lazada API, Shopee and blibli) develop pipeline using Python & ECS from Alicloud (Linux Based) BigData Tools : Meltano, Apache Airflow Implementation as WorkFlow Management, MetaBase as Visualisation, BigQuery as Datawarehouse and etc.

Reliable web scrapers & data pipelines that turn messy public data into clean, decision-ready datasets — at scale (100K+ records/day). 100% Job Success · 5.0★ · previously built 100,000+ RPS systems at ByteDance. I help teams collect, clean, and visualize data they can act on — from large-scale scraping to ETL pipelines and interactive dashboards. I care about clarity, reliability, and compliant data collection (robots.txt, ToS, rate limits, rotating proxies). What I deliver ✅ Web & social scraping (public data): Twitter/X, Instagram, YouTube, news, e-commerce ✅ ETL pipelines: cleaning, normalization, deduplication, scheduling, alerting ✅ Dashboards & data-viz: React/TypeScript, ECharts/D3, filters, maps, CSV/PDF export ✅ APIs & integrations: REST, auth, pagination, caching ✅ Deployment & handover: Docker, CI/CD, cron/Airflow, clear docs + maintenance plan Recent results • Pipelines processing 100K+ records/day across Twitter/IG/YouTube/news for sentiment & NER analysis • Operated an 8-server HPC cluster — reliability +25%, processing time −40% • Distributed scrapers with queueing (RabbitMQ) + monitoring (Grafana/Prometheus), ~99% uptime 🧰 Stack — Python (Scrapy, Playwright, Selenium, BeautifulSoup, Pandas), Node.js, PostgreSQL/MongoDB/Elasticsearch, Airflow/Prefect/Cron, RabbitMQ, Docker, GitHub Actions, GCP/AWS · React, TypeScript, Next.js, ECharts/D3. Available for long-term collaboration and one-off projects. Tell me about your data and the decision it needs to drive — I'll propose the simplest reliable approach.

Data Engineer specializing in Python ETL pipelines for cloud data warehouses. I build automated data engineering solutions processing millions of records daily, from real-time trading data to healthcare analytics. With over 6 years of experience, I have developed production ETL systems on GCP and AWS using Apache Airflow, Dagster, and modern data stacks. I architect data engineering solutions that handle schema changes, ensure data quality, scale with demand, and prevent 3 AM pipeline emergencies. DATA ENGINEERING & ETL EXPERTISE ETL Pipeline Development & Data Engineering I design scalable ETL pipelines and data engineering infrastructure using Python with Apache Airflow or Dagster. My solutions include automated error handling, data validation, and comprehensive monitoring. Cloud Data Engineering (GCP & AWS) I build cloud-native data engineering solutions and ETL pipelines on modern platforms: GCP: BigQuery, Dataflow, Cloud Functions, Pub/Sub AWS: Redshift, Glue, Lambda, S3, Kinesis Enterprise Data Warehouse Migration Reduced ETL processing time by 60% moving to GCP. Python Data Engineering & Pipeline Orchestration Python expert for data engineering and ETL development. I implement robust data workflow orchestration using Apache Airflow and Dagster with pipeline monitoring for data quality and reliability KEY DATA ENGINEERING & ETL PROJECTS - Election Data Pipeline: Python + Dagster + Clickhouse solution extracting campaign finance data, automating 40 hours/week of manual processing. - Real-Time Trading Pipeline: Multi-layer architecture for algorithmic trading, achieving <100ms latency and 100% uptime. - Healthcare Data Migration: Led enterprise ETL migration to GCP BigQuery, resulting in 60% faster processing and 50% better performance. - ML Feature Engineering: Built end-to-end data pipeline for AirAsia's recommendation system, processing millions of records and increasing engagement by 25%. - Web Scraping ETL: Automated solution combining scraping with warehousing using Python and Apache Airflow. - AWS Cloud System Stabilization: Enhanced stability and performance of AWS-based systems, focusing on S3, Lambda, and webhook integrations. - Manufacturing Data Platform Expansion: Supported and expanded a manufacturing data platform with SQL Server, Azure SQL, and ERP data mappings. DATA ENGINEERING TECH STACK ETL & Orchestration: Apache Airflow, Dagster, Apache Spark, Kafka, dbt Languages: Python (Expert), SQL (Expert) Cloud Platforms: GCP (BigQuery, Dataflow), AWS (Redshift, Glue, Lambda) Databases: PostgreSQL, Clickhouse, MongoDB, BigQuery, Redshift, Snowflake Python Libraries: Pandas, PySpark, SQLAlchemy, Apache Beam Infrastructure: Terraform, Docker, Kubernetes, CI/CD IDEAL PROJECTS ETL pipeline development from scratch (Python, Airflow, cloud platforms) Data warehouse engineering and cloud migration (BigQuery, Redshift, Snowflake) Real-time data engineering and streaming ETL implementation Legacy ETL modernization and data pipeline migration Web scraping data engineering with ETL workflows Data integration connecting multiple sources ML data pipeline engineering for feature engineering LET'S BUILD YOUR DATA ENGINEERING SOLUTION Available for fixed-price data engineering projects and long-term ETL contracts. I work across US, European, and Asian time zones (GMT+7). Ready to discuss your data engineering and ETL needs? Send me a message. I respond within 2 hours during business hours.

I am an experienced data engineer specializing in cloud solutions, data pipelines, and optimized data architectures. With over 8 years of hands-on experience, I have successfully led and executed data migration, ETL/ELT, and machine learning pipeline projects for major clients in the e-commerce, telecommunications, healthcare, and finance sectors. Skilled in GCP and AWS, I’m adept at improving data workflows, enhancing system performance, and delivering real-time data insights. Key Skills: Data Engineering: Airflow, Spark, Kafka, BigQuery, Pub/Sub Cloud & DevOps: GCP, AWS, Terraform, Kubernetes Programming: Python, Go, Java Machine Learning: TensorFlow, PyTorch, Tesseract With certifications like the Google Cloud Professional Data Engineer and strong experience in data infrastructure, I bring a proactive approach to problem-solving and a dedication to helping clients achieve scalable, cost-effective solutions.