Upwork home
Sign up
Secondary

Hire the best Apache Spark Engineers in Chennai, IN

Check out Apache Spark Engineers in Chennai, IN with the skills you need for your next job.
Hire freelancers
Clients rate Apache Spark Engineers
Rating is 4.7 out of 5.
4.7/5
based on 283 client reviews
  • $35 hourly

    • 5.0/5
    • (32 jobs)
    Seasoned data engineer with over 11 years of experience in building sophisticated and reliable ETL applications using Big Data and cloud stacks (Azure and AWS). TOP RATED PLUS . Collaborated with over 20 clients, accumulating more than 2000 hours on Upwork. 🏆 Expert in creating robust, scalable and cost-effective solutions using Big Data technologies for past 9 years. 🏆 The main areas of expertise are: 📍 Big data - Apache Spark, Spark Streaming, Hadoop, Kafka, Kafka Streams, Trino, HDFS, Hive, Solr, Airflow, Sqoop, NiFi, Flink 📍 AWS Cloud Services - AWS S3, AWS EC2, AWS Glue, AWS RedShift, AWS SQS, AWS RDS, AWS EMR 📍 Azure Cloud Services - Azure Data Factory, Azure Databricks, Azure HDInsights, Azure SQL 📍 Google Cloud Services - GCP DataProc 📍 Search Engine - Apache Solr 📍 NoSQL - HBase, Cassandra, MongoDB 📍 Platform - Data Warehousing, Data lake 📍 Visualization - Power BI 📍 Distributions - Cloudera 📍 DevOps - Jenkins 📍 Accelerators - Data Quality, Data Curation, Data Catalog
    Featured Skill Apache Spark
    SQL
    AWS Glue
    PySpark
    Apache Cassandra
    ETL Pipeline
    Apache Hive
    Apache NiFi
    Apache Kafka
    Big Data
    Apache Hadoop
    Scala
  • $60 hourly

    • 5.0/5
    • (7 jobs)
    Senior Software Engineer with 7 years of experience in functional programming, machine learning, AI & BigData. Also got front-end experience building websites and tools.
    Featured Skill Apache Spark
    Functional Programming
    React
    Big Data
    Apache Kafka
    Akka
    Apache Cassandra
    Amazon DynamoDB
    Databricks Platform
    Machine Learning
    Python
    Scala
    JavaScript
  • $100 hourly

    • 4.8/5
    • (2 jobs)
    AI and Cloud Data Engineer with over 15 years of Practical Experience in Banking and Networking Domain. Well-versed in defining requirements, designing solutions, and building solutions at an enterprise grade. A Passionate Programmer and Quick Troubleshooter. Strong grasp on Java, Python, Big Data Technologies, Data Engineering/Analysis and Cloud Computing.
    Featured Skill Apache Spark
    Apache Beam
    Apache Flink
    Data Science
    Microsoft Power BI
    Data Mining
    Apache Hadoop
    ETL
    Python
    Data Extraction
  • $40 hourly

    • 5.0/5
    • (2 jobs)
    Data Scientist with more than 14 years of full-time experience in delivering Machine Learning products. Delivered Data Science products and applications on NLP, Explainable AI as technical lead and as well as an individual contributor
    Featured Skill Apache Spark
    Script
    Artificial Intelligence
    Data Interpretation
    Python Script
    Git
    Server
    Linux
    BigQuery
    Machine Learning
    Data Science
    TensorFlow
    Python
    Recommendation System
    R
  • $40 hourly

    • 4.4/5
    • (2 jobs)
    I have over 8 years of experience in building graph based solutions both in OLTP and OLAP and also in predictive analytics. I have collaborated with IT Project Managers to understand their requirements, and independently delivered over 30 dashboards (each comprises more than 100 KPIs and viz) which is to analyze the productivity of teams.
    Featured Skill Apache Spark
    Spring Boot
    Docker
    Grafana
    Regex Writing
    PySpark
    Apache Lucene
    Python Scikit-Learn
    Oracle
    Amazon Neptune
    Neo4j
    TypeScript
    Node.js
    Java
    Python
  • $70 hourly

    • 0.0/5
    • (0 jobs)
    "Experienced Data Engineer specializing in big data technologies. Proven ability to design, develop, and optimize data pipelines using Spark, Hive, SQL, PL/SQL, and BigQuery. Skilled in transforming raw data into actionable insights for data-driven decision-making."
    Featured Skill Apache Spark
    Scala
    Python
    BigQuery
    Google Cloud Platform
    Unix Shell
    Big Data
    Data Engineering
  • $60 hourly

    • 0.0/5
    • (0 jobs)
    Hello, I’m Bindhusri, I have around 4 years of experience in database big data development. I’ve worked on all stages of software development, from planning and design to testing and support. I’m skilled in using Apache Hadoop for handling large data sets, loading data into Hive, and analyzing and manipulating data with Spark SQL. I can also manage data transfers between Hadoop clusters and handle data imports and exports with Sqoop. I’ve worked closely with Product Owners and business users to understand their needs and turn them into technical tasks. I have strong communication skills, teamwork, and ability to meet deadlines. I’m looking to join a forward-thinking firm where I can make a positive impact and continue to grow professionally
    Featured Skill Apache Spark
    PySpark
    GitHub
    SQL
    Scala
    Hive Technology
  • $16 hourly

    • 5.0/5
    • (4 jobs)
    If you are looking for End to End Data Developer.. Right from extracting the data , cleaning it and till the Visualization. Im the Guy... Please feel free to reach me TECHNICAL SKILLS BigData Platform : - AWS EMR,Huawei Fusion Insight, Cloudera, Azure Data Bricks BigData Technologies : - HDFS, Hive, Spark core, Spark SQL, Oozie, Spark Framework Streaming (Real-time) : - Spark Streaming (DStream & Structured stream) & Kafka Languages : - Scala, Python (Pyspark), SQL, UNIX shell scripting Development tools : - Scala IDE, IntelliJ Cloud : - AWS Data Services,Azure Data Lake, Azure Data Factory, Azure Data Bricks Databases : - Apache Hudi, SnowFlake, Azure SQL DB, MS SQL Server, Oracle 11g ETL : - Talend Data Fabric (DI and Big data), TAC, Talend Cloud, TMC, Informatica Power Center, Informatica Cloud (IICS & ICAI),SSIS CICD : - Jenkins, Nexus, Maven, GIT Visualization. :- Tableau
    Featured Skill Apache Spark
    Apache Hive
    Microsoft SQL Server Programming
    Talend Open Studio
    Scala
    Microsoft Azure
    Snowflake
    Talend Data Integration
    SQL
    Informatica Cloud
    Oracle Accounting
    HDFS
    Microsoft Azure SQL Database
    Informatica
    Apache Hadoop
    Databricks Platform
    Apache Kafka
  • $60 hourly

    • 0.0/5
    • (1 job)
    As a Senior Software Engineer with extensive experience in designing scalable systems, I specialize in building high-performance, secure architectures tailored to business needs. I have led and developed backend infrastructures from scratch, managed complex microservices, and ensured API efficiency and security for companies like Amazon and Pillow. My expertise spans technologies such as Node.js, Ruby, AWS, MongoDB, and more. I’ve successfully contributed to projects ranging from fraud prevention systems for 800M+ users to securing multi-million-dollar funding rounds. With a proven track record in leading teams and delivering robust solutions, I am committed to driving innovation and ensuring long-term scalability.
    Featured Skill Apache Spark
    Amazon Redshift
    NodeJS Framework
    Spring Framework
    Ruby on Rails
    Elasticsearch
    Amazon Web Services
    Software Architecture & Design
    MySQL
    TypeScript
    Golang
    PostgreSQL
    MongoDB
    Java
    SQL
  • $20 hourly

    • 5.0/5
    • (3 jobs)
    Data Integration & Big Data Specialist | Talend, Spark, Airflow, AWS Expert I am a seasoned Data Integration and Big Data Specialist with over 9 years of experience at Sopra Steria, delivering cutting-edge solutions using Hadoop, Talend, Spark, Airflow, and cloud technologies. My expertise lies in designing, implementing, and optimizing robust data pipelines and systems to handle complex business requirements. Key Strengths & Skills Data Engineering Expertise: Proficient in processing large datasets, both structured and semi-structured, with advanced Spark performance tuning to maximize efficiency. Cloud Specialist: Extensive experience in AWS services, including Redshift, S3, EMR, EC2, and Lambda, ensuring scalable and secure data processing. ETL Mastery: Designed and developed highly efficient Talend jobs for ETL processes, with a focus on performance optimization and scheduling in EC2. Orchestration & Automation: Expert in Apache Airflow for orchestration, designing complex DAGs, and automating data validations using shell scripting. CI/CD Implementation: Skilled in implementing CI/CD pipelines using Jenkins, streamlining deployment processes for enhanced efficiency. Cross-System Data Sync: Expertise in synchronizing data between AWS Redshift and Netezza. Notable Achievements Spark Optimization: Successfully tuned Spark jobs for large-scale data processing on Amazon EMR clusters, achieving significant performance improvements. Automation Initiatives: Designed and automated complex data validation frameworks, reducing manual intervention and increasing accuracy. Client Collaboration: Participated in sprint planning meetings, design discussions, and user story clarifications, ensuring smooth development and testing phases. Production Deployment: Led the deployment of Talend and Spark jobs in production clusters with meticulous configuration and monitoring. Education & Certifications B.Tech - Information Technology With a passion for solving data challenges and a proven track record of delivering impactful solutions, I am ready to contribute to your project with efficiency and precision. Let’s collaborate to turn your vision into reality!
    Featured Skill Apache Spark
    Apache Hadoop
    Data Warehousing & ETL Software
    ETL Pipeline
    Apache Airflow
    Amazon EC2
    Amazon Web Services
    Talend Open Studio
    Amazon Redshift
    Talend Data Integration
  • $10 hourly

    • 5.0/5
    • (1 job)
    GCP Certified Data Engineer | Python | SQL | Computer Vision | Power BI With a solid foundation, I bring a wealth of expertise to the table. As a Senior Data and automation Engineer with 5 years of industry experience, including working in both product-based and service-based companies, I excel in leveraging cutting-edge technology to deliver innovative solutions. 🔹 Skills Highlights: GCP Expertise: Proficient in leveraging the power of Google Cloud Platform for data engineering tasks, ensuring efficient and scalable solutions. Python : Adept at harnessing the capabilities of Python and PySpark to manipulate and analyze large datasets, driving actionable insights. SQL Mastery: Experienced in crafting complex SQL queries and optimizing database performance for streamlined data operations. Computer Vision - I have worked on computer vision, developing models like car damage detection, fuel nozzle connection detection, etc., and won the Image Analytics Hackathon. Power BI & Alteryx: Skilled in creating visually compelling dashboards and automating workflows using Power BI and Alteryx, empowering stakeholders with actionable insights. Problem-Solving: Known for my analytical mindset and ability to tackle complex challenges head-on, I thrive in dynamic environments where innovative solutions are required.
    Featured Skill Apache Spark
    Databricks Platform
    Microsoft Excel
    Apache Airflow
    pandas
    Data Warehousing
    Data Science
    ETL Pipeline
    Data Processing
    Google Cloud Platform
    Python
    SQL
    BigQuery
    Data Engineering
  • $20 hourly

    • 0.0/5
    • (0 jobs)
    Data Scientist: I am a Data Scientist proficient in leveraging statistical analysis, machine learning techniques, and domain expertise to derive actionable insights from complex datasets. With a strong foundation in mathematics, statistics, and programming languages like Python, I excel in manipulating large datasets and building predictive models. Collaborating closely with stakeholders, I identify business problems, analyze data, and develop algorithms to drive strategic initiatives and optimize processes. My expertise in data visualization and communication enables me to convey findings effectively to non-technical audiences, facilitating informed decision-making within organizations. Data Engineer: As a Data Engineer, I specialize in designing, building, and maintaining robust data infrastructure to support storage, processing, and analysis requirements. Proficient in programming languages such as SQL, Java, and Scala, I architect scalable data pipelines and integrate disparate data sources to ensure data quality and reliability. With expertise in big data technologies like Hadoop, Spark, and Kafka, I collaborate with cross-functional teams to understand data needs and implement solutions that meet organizational objectives. I also prioritize data governance and security practices to safeguard sensitive information, enabling businesses to derive actionable insights and make informed, data-driven decisions.
    Featured Skill Apache Spark
    MongoDB
    PySpark
    Apache Hadoop
    Data Engineering
    Data Science Consultation
    Data Science
    Statistical Analysis
    JupyterLab
    PyTorch
    pandas
    Python Scikit-Learn
    SciPy
    NumPy
    Python
  • $20 hourly

    • 0.0/5
    • (0 jobs)
    Experienced Data Engineer with 5 years of demonstrated expertise in designing, implementing, and optimizing data pipelines and architectures. Skilled in utilizing PySpark, SQL, Python, and AWS Cloud to transform raw data into actionable insights. Proven track record of collaborating effectively in cross-functional teams to deliver superior results. Adept at problem-solving and adeptly adapting to emerging technologies to facilitate data-driven decision-making processes.
    Featured Skill Apache Spark
    Amazon Redshift
    Docker
    NoSQL Database
    Data Mining
    Data Analysis
    ETL Pipeline
    ETL
    AWS Lambda
    AWS Glue
    Databricks Platform
    SQL
    Python
    PySpark
    Data Engineering
  • $15 hourly

    • 5.0/5
    • (2 jobs)
    Overall 6 years of experience in IT industry with 4 years of relevant experience in Big Data Engineer, handling and transforming heterogeneous data into Key information using Hadoop ecosystem. - Expertise with the tools in Hadoop Ecosystem – HDFS, Hive , Sqoop, Spark, Kafka, Nifi. - Experience working with Elastic Search, Kibana and good knowledge on Oozie, Hbase, Phonix. - Good understanding of distributed systems, HDFS architecture, internal working details of MapReduce, Yarn and Spark processing frameworks. - More than two year of hands on experience using Spark framework with Scala. - Expertise in Inbound and Outbound (importing/exporting) data form/to traditional RDBMS using ApacheSQOOP. - Extensively worked on HiveQL, join operations, writing custom UDF’s and having good experience in optimizing Hive Queries. - Experience in data processing like collecting, aggregating, moving from various sources using Apache Nifi and Kafka. - Worked with various formats of files like delimited text files , JSON files, XML Files - Having basic knowledge on Amazon Web Services.
    Featured Skill Apache Spark
    Data Lake
    AWS CloudFormation
    AWS Glue
    Elasticsearch
    Kibana
    Sqoop
    Apache NiFi
    PySpark
    Scala
    SQL
    Apache Hadoop
    Apache Kafka
    Apache Hive
  • $12 hourly

    • 0.0/5
    • (0 jobs)
    • Having 7 Years of Experience in Bigdata • Having working experience in Hadoop Ecosystem like Apache Storm, Flume, Kafka, Spark, Orient DB, Elastic Search, HDFS, Mapreduce, Hive, Sqoop etc. • Having hands-on experience with Spark with Machine learning(ML). • Having working experience in Core Java, J2EE, JSP, Servlet, Struts 1.x, Spring MVC, Hibernate Framework and JDBC. • Experience in Educational, E-commerce and Banking Domains. • Hands on experience in developing end-to-end solution of software products/Web Applications from requirement analysis to system study, designing, coding, unit testing, de-bugging, documentation and implementation.
    Featured Skill Apache Spark
    Apache Flume
    Apache Kafka
    Apache Storm
    Apache Hive
    Machine Learning
    Java
    Spring Framework
    jQuery
  • $50 hourly

    • 0.0/5
    • (0 jobs)
    * Having 15 years of IT experience with various technologies JAVA, J2EE, Servlets, JDBC, JSP, Struts, Spring with Hibernate, Spring boot, Micro services, HIVE, Scala, Spark, Kafka, Elastic Log Stash (ELK), Kubernetes, Docker, Jenkins, GIT, Bit Bucket, AWS IAM,EC2, RDS, EKS, SNS, S3,Lamda, ECS, AZURE Cloud with DevCloud, RHEL, Maven, Groovy, Python, Shell Scripting, Control-M, Autosys, Tivoli, Monitoring tools Grafana, Prometheus, AppDynamics, MQ, SOAP & RESTful Web Services, JUnit, Selenium, Cucumber, Redis, MySQL, Oracle, Maria DB, JBOSS, WebSphere, Tomcat.. etc. * Deploying the applications in Tomcat Web Server, JBOSS and Web Sphere 8.0 application Servers. * Have work experience on Agile & waterfall Methodologies * Implement the REST API & Data Security Gateway (DSG) services. * Good experience on Spring Boot, spring with Hibernate, Struts frameworks along with Hadoop tools.
    Featured Skill Apache Spark
    Scala
    Python
    Docker
    Kubernetes
    ELK Stack
    Apache Kafka
    Selenium
    Cucumber
    Spring Batch
    Spring Boot
    Java
    Script
    Product Development
    Web Development
  • $45 hourly

    • 0.0/5
    • (0 jobs)
    SUMMARY Accomplished Technical Architect with 18+ years experience in designing and implementing scalable, secure, and high-performance systems. Expertise in Java, Spring Boot, and cloud-based microservices, with a proven track record of leading cross-functional teams to deliver innovative solutions. Notable achievements include architecting an event-driven system at Roche Information Solutions (Santa Clara, US) and engineering high-performance applications at the Multi- Commodity Exchange of India. Proficient in a wide range of technologies including Docker, Kubernetes, and various databases such as Oracle and DB2. Career goal: to continue leveraging technical expertise to drive digital transformation in the healthcare and financial sectors.
    Featured Skill Apache Spark
    Artificial Intelligence
    Ecommerce
    Cloud Architecture
    AWS Development
    Web Development
    International Development
    Security Framework
    Gradle
    Apache Maven
    Spring Framework
    Spring Boot
    Microservice
    Java Collections Framework
  • $30 hourly

    • 0.0/5
    • (0 jobs)
    Seasoned software engineer offering 17+ years of expertise in development and architecture. Focused on building high-performance, scalable, and maintainable applications. Adept at translating business requirements into technical solutions. Hands on knowledge on Web development with Java, Spring & Hibernate with indept Cloud technology knowledge on AWS and Dev ops exposure on Kubernetes and containerization.
    Featured Skill Apache Spark
    AWS Development
    Kubernetes
    Web Development
    Web Application
    Java Collections Framework
    Java Persistence API
    Angular 10
    Hibernate
    Spring Batch
    Spring MVC
    Spring HATEOAS
    Spring Framework
    Spring Boot
    Java
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

How do I hire a Apache Spark Engineer near Chennai, on Upwork?

You can hire a Apache Spark Engineer near Chennai, on Upwork in four simple steps:

  • Create a job post tailored to your Apache Spark Engineer project scope. We’ll walk you through the process step by step.
  • Browse top Apache Spark Engineer talent on Upwork and invite them to your project.
  • Once the proposals start flowing in, create a shortlist of top Apache Spark Engineer profiles and interview.
  • Hire the right Apache Spark Engineer for your project from Upwork, the world’s largest work marketplace.

At Upwork, we believe talent staffing should be easy.

How much does it cost to hire a Apache Spark Engineer?

Rates charged by Apache Spark Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.

Why hire a Apache Spark Engineer near Chennai, on Upwork?

As the world’s work marketplace, we connect highly-skilled freelance Apache Spark Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Apache Spark Engineer team you need to succeed.

Can I hire a Apache Spark Engineer near Chennai, within 24 hours on Upwork?

Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Apache Spark Engineer proposals within 24 hours of posting a job description.

Looking to hire for long-term or full-time assignments? See how Full-time hiring on Upwork simplifies the process.