Skills * HDFS * KAFKA * Kubernetes * AWS * Hive * Sqoop * HBase * Zookeeper * Ambari * Hue * Spark * Storm * Map reduce * ELK * CDH * HDP * Ranger * JupyterHub * Shell * Java Professional Summary * Passionate Professional with 13+ years of experience in the field of Information Technology * A Big Data professional with around 7 plus years of experience in Hadoop Platform Administration, Kafka, ELK stack, STORM and SPARK Administration * Have experience of managing large Hadoop Clusters of various distributions (HDP, Cloudera and CDP). Experience in troubleshooting production servers, infrastructure, and application issues

US Navy Veteran with a passion for information systems, software development, and game design. Professional C# developer for over 10 years. Whether you're trying to maintain old code, design new systems, or just need a second set of eyes or hands, I'm here to help solve your problems.

AI Consultant | Full-Stack Web & Android App Developer | 25+ Years of Experience Need someone who can turn your idea into a working product? I'm a software professional with 25+ years of experience in software development and IT project delivery. As an independent AI consultant and full-stack developer, I help startups and businesses build practical, scalable solutions. I develop AI-powered applications, modern web apps, Android apps, and business automation solutions. Whether you need ChatGPT integration, a custom AI assistant, a Firebase-backed application, API integrations, or an end-to-end solution, I can help bring your ideas to life. Core expertise: AI Consulting & ChatGPT Integration Web & Android App Development Firebase & Cloud Solutions API Integration & Automation Solution Architecture

Site Reliability Engineer with a strong background in software engineering (Go and Java) and system design for high availability. I specialize in Observability and build tools that help developers monitor, debug, and operate reliable services at scale.

I am a seasoned Data Engineer and Big Data Specialist with over 7 years of experience in building and optimizing scalable data pipelines, crafting real-time analytics solutions, and leveraging cloud technologies to deliver business value. My expertise spans across Big Data Ecosystems, Cloud Platforms, and Data Warehousing, ensuring end-to-end solutions for data-driven decision-making. 𝗗𝗼𝗺𝗮𝗶𝗻 𝗘𝘅𝗽𝗲𝗿𝘁𝗶𝘀𝗲 : 𝗣𝗵𝗮𝗿𝗺𝗮𝗰𝗲𝘂𝘁𝗶𝗰𝗮𝗹 𝗜𝗻𝗱𝘂𝘀𝘁𝗿𝘆 – Extensive experience in clinical data management, working with IQVIA, Sanofi, and optimizing study data pipelines for pharmaceutical research and trials. 𝗙𝗶𝗻𝗮𝗻𝗰𝗶𝗮𝗹 𝗦𝗲𝗰𝘁𝗼𝗿 – Expertise in the insurance domain, handling claims processing, policy data management, and ensuring compliance with industry regulations. 𝗥𝗲𝗰𝗿𝘂𝗶𝘁𝗺𝗲𝗻𝘁 𝗜𝗻𝗱𝘂𝘀𝘁𝗿𝘆 – Worked with job advertisement data, company insights, geographical talent search, and salary analytics to enhance recruitment strategies. 𝐊𝐞𝐲 𝐇𝐢𝐠𝐡𝐥𝐢𝐠𝐡𝐭𝐬: Extensive experience in Big Data Analytics, specializing in Apache Spark, Kafka, NIFI, and Databricks, with a strong focus on Delta Lake, Streaming, and Batch Processing. Proficient in building robust ETL/ELT pipelines and designing OLAP data models using technologies Redshift, Snowflake, and BigQuery with dbt transformation. Hands-on expertise in AWS (Glue, S3, EMR, Lambda, Step Functions) and Azure (Databricks, ADF, CosmosDB) to build scalable, cloud-native architectures. Experienced in Docker containerization and deploying distributed applications across various environments. Adept at orchestrating data pipelines with Apache Airflow, Jenkins, and automated CI/CD workflows to streamline production deployments. Skilled in programming with Python and Pandas, with exposure to Scala for efficient data transformation and processing. 𝐋𝐞𝐚𝐝𝐞𝐫𝐬𝐡𝐢𝐩 & 𝐂𝐨𝐥𝐥𝐚𝐛𝐨𝐫𝐚𝐭𝐢𝐨𝐧: Proven track record in mentoring and leading technical teams, ensuring high-quality deliverables and fostering innovation. Experienced in collaborating with cross-functional teams, translating complex requirements into scalable solutions, and ensuring alignment with business goals. Passionate about adopting Agile (Scrum) and DevOps methodologies to enhance development efficiency and team collaboration. 𝐖𝐡𝐲 𝐂𝐨𝐧𝐧𝐞𝐜𝐭 𝐖𝐢𝐭𝐡 𝐌𝐞? I thrive on solving complex data challenges, driving impactful insights. Whether it’s optimizing data architectures, building real-time analytics solutions, or mentoring teams, Let’s connect and discuss how we can shape the future of data together!

Polyglot Software Engineer adept in bringing forth expertise in design, installation, testing and maintenance of software systems. Able to effectively self-manage during independent projects, as well as collaborate as part of a productive team.

I'm a Backend & Data Engineer who builds reliable backend systems and data processing solutions using TypeScript, SQL, and modern database technologies. I can help you with: - Backend API development - Database design and optimization (PostgreSQL, MongoDB) - ETL pipelines and data processing I believe good software is more than just working code. I focus on writing clean, maintainable solutions with clear documentation, organized project structure, and deployment scripts that make projects easy to understand and maintain.

Senior Data Engineer with 7+ years of experience designing scalable cloud-native data platforms, ETL pipelines, and AI-powered analytics solutions across healthcare, finance, retail, and enterprise environments. I specialize in Python, PySpark, Apache Spark, Kafka, Snowflake, Databricks, SQL, AWS, Azure, and modern AI technologies including LangChain, Vector Databases, OpenAI APIs, and Retrieval-Augmented Generation (RAG). My expertise includes: • Building high-performance ETL/ELT pipelines • Data warehouse architecture • Azure Data Factory & Databricks • Snowflake optimization • Real-time streaming using Kafka & Spark • Machine Learning data pipelines • AI applications using LangChain and OpenAI • Cloud migration • Dashboard & analytics solutions I focus on building reliable, scalable, and production-ready data platforms that help businesses make better decisions and deploy AI successfully.

I help businesses build scalable, high-performance data platforms and ETL pipelines using modern big data and cloud technologies. With 7+ years of experience in banking and healthcare domains, I've delivered enterprise-grade solutions for processing terabytes of data, real-time streaming, and cloud-based analytics. Expertise: Apache Spark, PySpark, Java, SQL, Databricks, Snowflake, Kafka, Hadoop, AWS, Azure, Delta Lake, and ETL pipeline development. From designing data architectures and optimizing Spark jobs to implementing cloud-native data solutions, I can support your project from planning through deployment. Clear communication and delivering quality work on time are my priorities.

Summary Skills: Hadoop: Nifi, Sqoop, Kafka, HDFS, Schema Registry, Atlas, Streams Messaging Manager. Programming Languages / Scripting: SQL, NOSQL, Python, R, Bash, C#, API. Relational Databases: Oracle, MYSQL, PostgreSQL, Hive. Non-Relational Databases (NOSQL): HBase, MongoDB. Data Virtualization: Tibco Data Virtualization Studio. Data Visualization: Tibco Spotfire, Power BI, MongoDB Charts, DataIku, Kibana, ThingsBoard, Banana BI. ELK Stack: ElasticSearch, Logstash, Kibana. Experience: * Design and development of processes for automatically extracting, transforming and loading data from external data sources into the perimeter of the Hadoop Data Hub. * Development of applications for multi-threaded processing, enrichment and aggregation of data from various streams in real time for banking systems. * BI development. * Building visualizations (reports) for data analysis from insurance systems, loyalty programs and the flow of transactions. * IronPython/R scripts for BI.