Sr. Big Data Engineer

We are looking for an experienced Apache Kafka and Apache NiFi expert to design, build, and optimize a robust, scalable, and reliable data pipeline capable of processing and migrating large volumes of data from Microsoft SQL Server into HDFS. The expert should have strong hands-on experience in real-time and batch data ingestion, data flow orchestration, performance tuning, fault tolerance, monitoring, and error handling. The role requires deep understanding of Kafka topics, producers, consumers, partitioning, replication, and NiFi processors, controllers, flow management, and security configurations. The objective is to ensure high-throughput data movement, data integrity, operational stability, and efficient handling of large-scale datasets while supporting future scalability and maintainability of the overall data platform.