Upwork home
Sign up
Secondary

Hire the best Big Data Engineers in Chennai, IN

Check out Big Data Engineers in Chennai, IN with the skills you need for your next job.
Hire freelancers
Clients rate Big Data Engineers
Rating is 4.8 out of 5.
4.8/5
based on 294 client reviews
  2. Big Data Engineers
  3. India
  4. (Current) Chennai
  • $35 hourly

    • 5.0/5
    • (32 jobs)
    Seasoned data engineer with over 11 years of experience in building sophisticated and reliable ETL applications using Big Data and cloud stacks (Azure and AWS). TOP RATED PLUS . Collaborated with over 20 clients, accumulating more than 2000 hours on Upwork. 🏆 Expert in creating robust, scalable and cost-effective solutions using Big Data technologies for past 9 years. 🏆 The main areas of expertise are: 📍 Big data - Apache Spark, Spark Streaming, Hadoop, Kafka, Kafka Streams, Trino, HDFS, Hive, Solr, Airflow, Sqoop, NiFi, Flink 📍 AWS Cloud Services - AWS S3, AWS EC2, AWS Glue, AWS RedShift, AWS SQS, AWS RDS, AWS EMR 📍 Azure Cloud Services - Azure Data Factory, Azure Databricks, Azure HDInsights, Azure SQL 📍 Google Cloud Services - GCP DataProc 📍 Search Engine - Apache Solr 📍 NoSQL - HBase, Cassandra, MongoDB 📍 Platform - Data Warehousing, Data lake 📍 Visualization - Power BI 📍 Distributions - Cloudera 📍 DevOps - Jenkins 📍 Accelerators - Data Quality, Data Curation, Data Catalog
    Featured Skill Big Data
    SQL
    AWS Glue
    PySpark
    Apache Cassandra
    ETL Pipeline
    Apache Hive
    Apache NiFi
    Apache Kafka
    Apache Hadoop
    Scala
    Apache Spark
  • $60 hourly

    • 5.0/5
    • (7 jobs)
    Senior Software Engineer with 7 years of experience in functional programming, machine learning, AI & BigData. Also got front-end experience building websites and tools.
    Featured Skill Big Data
    Functional Programming
    React
    Apache Kafka
    Akka
    Apache Cassandra
    Amazon DynamoDB
    Databricks Platform
    Machine Learning
    Apache Spark
    Python
    Scala
    JavaScript
  • $80 hourly

    • 4.8/5
    • (544 jobs)
    This is Raj, CEO from BICS GLOBAL. I am 10+ years of experience in Software development and 8+ years of experience in salesforce implementation and Salesforce Integration. SALESFORCE SPECIALTIES 💎 Salesforce® Consulting 💎 Salesforce® Implementation 💎 Salesforce® Integration 💎 Salesforce® AppExchange 💎 Salesforce® Lightning 💎 Salesforce® CPQ 💎 Salesforce® Einstein MARKETING CLOUD SPECIALTIES 💎 Exact Target 💎 Pardot 💎 HubSpot 💎 Adobe Campaign Management 💎 MailChimp 💎 Eloqua 💎 Marketo ✅ Years of experience working in the Information Technology field covering requirements gathering, process analysis, application design, testing, project management, business intelligence, application development and IT service management. ✅ Solid Project Development and ERP/CRM experience in delivering IT solutions to meet end-user expectations and business objectives. ✅ Strong technical background and ability to effectively brainstorm solution options with technical resources to deliver client’s requirements. ✅ Adequate knowledge of the latest Data solutions and technologies along with their usage context. ✪✪ Experienced in SalesForce.com Apex Classes, Apex Triggers, Visual Force, Custom components, Custom Settings, Force.com API. Hands on experience in developing and deploying custom integration Salesforce.com CRM solutions. ✪✪ Experienced in Salesforce1, Salesforce Mobile Development, Lightning, Experienced with single sign on implementation. ✪✪ Extensive experience in designing custom objects, custom field, picklist, role based layouts, Workflow Alerts and Actions, and Approval Workflow, Validation Rules, Approval processes, Custom Tabs, Custom report, Report folder, report extractions to various formats, design of Visual Force Pages, Snapchat, Dashboards, and Email generation according to the application requirements. ✪✪ Hands on experience with Profile, Permission Sets, organization Wide Defaults and Roles. ✪✪Experienced customizing standard objects Accounts, Contacts, opportunities, products, price books, Cases, Leads, Campaigns, Report and Dashboards Requirement Gathering. ✪✪ Design and configure Salesforce solutions using Marketing Cloud Social Studio, Email Builder, Journey Builder, Salesforce Admin, Pardot, HTML and CSS skills, Proficient in Amp scripting and content builder
    Featured Skill Big Data
    Salesforce Marketing Cloud
    Salesforce App Development
    Business Intelligence
    Tableau
    Apex
    Mobile Development Framework
    Magento
    Salesforce CRM
    Mobile App Development
  • $49 hourly

    • 4.0/5
    • (7 jobs)
    I am an innovative and experienced AI Research Scientist with a passion for solving complex problems and delivering cutting-edge AI solutions. My extensive background in machine learning, deep learning, and data science enables me to create high-impact, tailored solutions for diverse industry needs. I am committed to helping clients achieve their goals by leveraging state-of-the-art AI technologies and best practices. My core expertise includes: 1. Machine Learning and Deep Learning: Proficient in various ML and DL algorithms, including supervised, unsupervised, and reinforcement learning techniques. Skilled in designing and implementing custom models for a wide range of applications. 2. Natural Language Processing and Computer Vision: Expert in developing advanced NLP and computer vision solutions, such as sentiment analysis, chatbots, object detection, and image recognition. 3. AI Frameworks and Libraries: Highly experienced with popular AI frameworks and libraries, including TensorFlow, Keras, PyTorch, and scikit-learn, allowing for efficient model development and deployment. 4. Python Programming: Adept at writing clean, efficient, and well-documented Python code to implement AI algorithms, process and analyze data, and develop custom software solutions. 5. Data Science and Analytics: Strong background in data preprocessing, feature engineering, and statistical analysis to support AI model development and optimization. 6. AI Ethics and Bias Mitigation: Committed to ensuring AI solutions are developed responsibly, with a focus on reducing bias, ensuring transparency, and maintaining ethical standards. 7. Big Data and Cloud Computing: Experienced with big data processing tools like Hadoop and Spark, as well as cloud computing platforms like AWS, GCP, and Azure for scalable AI solutions. 8. AI Project Management and Strategy: Skilled in managing AI projects from ideation to deployment, ensuring successful and timely delivery while maintaining clear communication with clients and stakeholders. Whether you require an AI-powered recommendation system, an intelligent chatbot, or a custom deep learning solution, I am dedicated to providing top-notch AI services to help you stay ahead in the rapidly evolving world of artificial intelligence. Let's work together to turn your AI vision into reality!
    Featured Skill Big Data
    Algorithm Development
    Artificial Intelligence
    Computer Science
    Project Management
    Certified Associate in Python Programming
    Deep Learning
    TensorFlow
    Computer Vision
    Data Science
    PyTorch
    Machine Learning
    Natural Language Processing
  • $60 hourly

    • 0.0/5
    • (1 job)
    I Specialize in building Data Warehouses, Data lakes, Data Integration, Data Modeling, Data lifecycle Management, Data Governance, and architecture solutions with an extensive experience of more than 18 years. I am an expert in building ETL/ELT data pipelines on distributed infrastructure applications, both on-prem and cloud. As an expert in Dimensional Modeling, I have built several Data marts over on-prem and cloud Datawarehouses.
    Featured Skill Big Data
    Snowflake
    Orchestration
    Containerization
    Microservice
    Data Management
    Data Ingestion
    Data Modeling
    Data Lake
    Informatica Data Quality
    Informatica
    PySpark
    Data Engineering
    Python
  • $70 hourly

    • 0.0/5
    • (0 jobs)
    "Experienced Data Engineer specializing in big data technologies. Proven ability to design, develop, and optimize data pipelines using Spark, Hive, SQL, PL/SQL, and BigQuery. Skilled in transforming raw data into actionable insights for data-driven decision-making."
    Featured Skill Big Data
    Scala
    Python
    BigQuery
    Google Cloud Platform
    Apache Spark
    Unix Shell
    Data Engineering
  • $15 hourly

    • 0.0/5
    • (0 jobs)
    I am a highly motivated and results-driven software developer, data scientist, and AI enthusiast with expertise in full-stack development, artificial intelligence (AI), machine learning (ML), and data analytics. I specialize in building scalable, efficient applications and leveraging data to drive insights. My approach is centered around continuous learning, problem-solving, and delivering high-quality, client-oriented solutions. Key Strengths & Skills Full-Stack Development: Proficient in developing both front-end and back-end applications using technologies like Flutter, Node.js, SvelteKit JS, Golang, and Mongoose ORM. I am experienced in creating responsive mobile apps, web applications, and managing databases like MongoDB, MySQL, and PostgreSQL. Artificial Intelligence & Machine Learning: Experienced in building and deploying machine learning models, with expertise in supervised learning, unsupervised learning, and deep learning using libraries such as TensorFlow, Keras, Scikit-learn, and PyTorch. I implement algorithms such as K-Means, DBSCAN, Agglomerative Clustering, and NLP techniques. Data Science & Analytics: Skilled in data cleaning, data analysis, and visualization using Python (Pandas, NumPy), R, SQL, and tools like Tableau and Power BI to present insights clearly. Cloud Deployment & CI/CD: Adept at deploying applications on cloud platforms like AWS EC2 and setting up CI/CD pipelines with GitLab Runner for automated testing and integration. Open-Source Contributions: Contributed to AI and machine learning projects on GitHub, focusing on optimization algorithms and data preprocessing to improve the efficiency of machine learning workflows. Notable Projects 1. Campus~Link - College ERP Mobile App Developed a Flutter-based mobile app to automate college operations, including OD request processing, a dynamic chat feature for student-faculty communication, and a centralized feed for real-time updates. This project significantly improved engagement and operational efficiency within the college community. Technologies Used: Flutter, Node.js, Mongoose ORM, Firebase Features: OD request automation for smoother administrative processes. Dynamic chat feature for real-time student-faculty communication. Centralized college updates via an easy-to-use feed. 2. UI-Networking - Multi-Level Marketing Platform Built a multi-level digital marketing platform using SvelteKit JS, Golang, and MariaDB, featuring a hierarchical points system where users earn points based on product purchases. The platform also integrated CI/CD pipelines and was deployed on AWS EC2 for enhanced performance and scalability. Technologies Used: SvelteKit JS, Golang, MariaDB, AWS EC2, nginx, GitLab CI/CD Features: Hierarchical reward system for multi-level marketing. CI/CD pipelines for seamless integration and deployment. AWS EC2 hosting for scalable, high-performance hosting. 3. Airbnb Data Clustering Analysis Used clustering algorithms such as K-Means, DBSCAN, and Agglomerative Clustering to analyze and segment Airbnb listings based on factors like location, price, and guest ratings. I evaluated the model performance using metrics like Silhouette Score to determine the most effective clustering strategy. Technologies Used: Python, Scikit-learn, Pandas, Matplotlib Features: Clustering of Airbnb listings to identify trends and insights. Evaluation of clustering results using Silhouette Score and other metrics. 4. AI Optimization Research Contributed to open-source AI projects on GitHub, focusing on improving optimization algorithms and creating data preprocessing pipelines to streamline machine learning workflows and enhance model efficiency. Technologies Used: Python, TensorFlow, PyTorch, Scikit-learn Features: Optimization algorithm improvements for better model accuracy and efficiency. Data preprocessing tools for improved data cleaning and feature extraction. Why Work With Me? I bring a blend of technical proficiency, problem-solving skills, and a passion for delivering results. Whether it’s building a user-friendly mobile app, deploying a cloud-based application, or implementing an AI model to gain valuable insights from data, I focus on providing tailored solutions that exceed expectations. I take pride in my ability to understand client needs and deliver custom solutions that drive success. If you're looking for a dedicated professional to turn your ideas into reality, I’m ready to collaborate with you and create something exceptional. Let’s connect and make your next project a success!
    Featured Skill Big Data
    Neo4j
    Deep Learning
    OpenCV
    Machine Vision
    R
    Apache Hadoop
    Data Cloud
    NodeJS Framework
    FastAPI
    TensorFlow
    PyTorch
    C
    Java
    Python
  • $9 hourly

    • 0.0/5
    • (1 job)
    I am a Ai developer with the expertise in the neural network and I have worked for the company to automate the some commercial bank operations using the chatbot (NLP) ,natural language processing is one of my specialty. INDUSTRY PROJECTS • Intern at TTF powered by Temenos (T24) Developed an Advanced Ai chatbot to automate the commercial banking operations (Dur: 2month) • Intern at TCS NLP (Dur: 2month) • Intern at NeoDocta Data Analyst (Dur: 6month) • Intern at Benz Data Analyst (Dur: 1month) • Intern at MCW (Dur:2 years) SKILLS PROGRAMMING Java • Python • R • php • C Exams MongoDB certified Associate Developer Azure certified Associate Ai and Ml engineer Familiar Software: Robodk(cad) • PowerBI • Tableau • MySQL• MongoDB• Hadoop Azure, Mongo DB atlas, Aws Knowledge: Machine Learning Algorithms Deep learning Algorithms Data Structures Data Mining Robotics Big Data Analytics
    Featured Skill Big Data
    Data Mining
    Analytics
    Algorithm Development
    MongoDB
    Artificial Intelligence
    Deep Tone
    Data Analytics
    Apache Hadoop
    Deep Learning Modeling
    MySQL Programming
    Deep Neural Network
    Deep Learning
    Machine Learning Model
  • $15 hourly

    • 0.0/5
    • (0 jobs)
    Hi there! I'm Vijay Karthick, a passionate and results-driven professional with expertise in AI, data science, and analytics. With a strong foundation in crafting data-driven solutions, I specialize in turning complex challenges into actionable insights. I bring experience in developing advanced machine learning models, designing intuitive dashboards, and delivering end-to-end AI solutions. Whether it's predictive analytics, automation, or building applications to optimize business performance, my focus is always on delivering high-quality results that align with your goals. 𝐖𝐡𝐲 𝐰𝐨𝐫𝐤 𝐰𝐢𝐭𝐡 𝐦𝐞? 𝐏𝐫𝐨𝐛𝐥𝐞𝐦-𝐒𝐨𝐥𝐯𝐢𝐧𝐠: I thrive on tackling tough challenges and finding innovative solutions. 𝐃𝐞𝐭𝐚𝐢𝐥-𝐎𝐫𝐢𝐞𝐧𝐭𝐞𝐝: I ensure every project meets the highest standards of accuracy and efficiency. 𝐂𝐥𝐢𝐞𝐧𝐭-𝐂𝐞𝐧𝐭𝐫𝐢𝐜: Your satisfaction is my priority, and I’m dedicated to transparent communication and timely delivery. Let’s collaborate to bring your ideas to life and achieve remarkable outcomes together!
    Featured Skill Big Data
    PyTorch
    TensorFlow
    Jupyter Notebook
    Data Visualization
    Microsoft Power BI
    SQL
    Database
    Deep Learning
    Statistical Analysis
    Python
    Data Science
    Data Analytics
    Data Analysis
    Machine Learning
  • $5 hourly

    • 0.0/5
    • (0 jobs)
    I’m a Data Engineer with 3+ years of experience in data transformation, visualization, and automation. I specialize in building scalable data pipelines, integrating APIs, and developing dashboards to empower businesses with data-driven decision-making. 💡 What I Can Do for You: ✅ Data Engineering & ETL – Extract, transform, and load (ETL) data from multiple sources into structured formats for analysis. ✅ Python Development – Automate data processes, develop APIs, and work with JSON for seamless data exchanges. ✅ Data Visualization – Build interactive Power BI dashboards to uncover insights and track KPIs. ✅ Airtable Customization – Design workflow automation and database structures to streamline business operations. ✅ AI Model Evaluation – Train and assess models for accurate forecasting and data predictions. ✅ API Integration – Connect internal and external systems to automate workflows and ensure smooth data flow. 🛠 Tech Stack & Tools: 🔹 Python (Pandas, NumPy, JSON, APIs) 🔹 SQL (Data Queries & Optimization) 🔹 Power BI (Dashboards & Data Modeling) 🔹 Airtable (Database Structuring & Automation) 🔹 Jupyter Notebooks (Analysis & Documentation) 🔹 Data Warehousing & Transformation 🌟 Why Work with Me? ✔️ Detail-Oriented – I ensure clean, structured, and meaningful data. ✔️ Business-Focused – I align technical solutions with business needs. ✔️ Automation-Driven – I optimize workflows and eliminate manual bottlenecks.
    Featured Skill Big Data
    Databricks MLflow
    Databricks Platform
    PySpark
    Data Cleaning
    Python
    SQL
    Tableau
    Zapier
    Machine Learning Model
    Data Analysis
    Analytical Presentation
    n8n
    Airtable
    Microsoft Power BI
  • $5 hourly

    • 0.0/5
    • (0 jobs)
    Hello! I'm a passionate and results-driven professional with a strong background in business development and technology. At 20 years old, I'm focused on delivering high-quality, client-oriented solutions in areas such as web development, software engineering, and AI. With experience in managing projects, understanding market needs, and creating efficient strategies, I bring both creativity and technical expertise to every project I work on. Whether you're looking for a developer to bring your website to life or a consultant for business growth, I am dedicated to ensuring successful outcomes. I work with a clear understanding of deadlines, high standards, and customer satisfaction. Let’s collaborate to make your ideas and projects a reality!
    Featured Skill Big Data
    Machine Learning Model
    Machine Learning
    Artificial Intelligence
    ETL
    Analytical Presentation
    Microsoft Power BI
    Microsoft Excel
    Excel Formula
    OpenAI API
    DALL-E
    Data Analytics
    Data Analysis
  • $30 hourly

    • 0.0/5
    • (0 jobs)
    Proficient in tools like Databricks, Big data technology, Automation, AWS/AZURE/GCP Cloud, Python, PySpark, SparkSQL, SQL, Jira, GitHub, Hive, Teradata, Minio, Apache Nifi, Hive, Python, Informatica Corp.’s PowerCenter, and Scripting; also skilled in Bash/Linux/UNIX Commands, Tableau, DevOps, Presto.
    Featured Skill Big Data
    Databricks Platform
    SQL
    Data Science
    Machine Learning
    Unix Shell
    Data Analysis
    ETL
    DevOps Engineering
    PySpark
    Python
    Google Cloud Platform
    Microsoft Azure
    AWS Application
    Automation
  • $25 hourly

    • 0.0/5
    • (0 jobs)
    SUMMARY * Having 10 + years of experience as Data Engineer * 3+ years in GCP cloud Components - GCS, BQ, Dataproc & Terraform * 6+ years of experience working in Hadoop Ecosystem - Hive , Pyspark * Migrated functionality between different platform - MF to HDP, HDP to GCP * Strong advocate of Agile methodologies and continuous integration/continuous deployment (CI/CD) * Passionate about building and guiding teams towards technical excellence and delivering impactful software solutions * Worked on AWS components - S3 & EMR
    Featured Skill Big Data
    GitHub
    GitHub Copilot
    ETL
    Teradata
    Informatica
    Apache Airflow
    Python
    BigQuery
    Hive
    PySpark
  • $30 hourly

    • 0.0/5
    • (0 jobs)
    As a highly skilled Data Engineer, I specialize in building robust, scalable data pipelines and transforming raw data into actionable insights. With extensive experience in ETL (Extract, Transform, Load) processes, big data, data warehousing, and real-time data processing, I ensure your data infrastructure is efficient, reliable, and future-proof. I am proficient in SQL, Python, data modeling, and data integration, leveraging tools like Snowflake, Apache HOP, and advanced data lakes to craft end-to-end solutions that scale. My expertise also spans data quality, stream processing, and data security, ensuring both the integrity and confidentiality of your data. Whether you're looking to optimize your data workflows, implement custom data pipelines, or enable seamless data integration, I bring innovative solutions tailored to your unique business needs. Let’s collaborate to unlock the true potential of your data and drive impactful decisions with precision and speed.
    Featured Skill Big Data
    Data Warehousing
    Data Visualization
    Real Time Stream Processing
    Data Integration
    Data Quality Assessment
    Data Modeling
    Python
    SQL
    Data Lake
    Snowflake
    Data Analysis
    ETL Pipeline
    ETL
    Data Extraction
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

How do I hire a Big Data Engineer near Chennai, on Upwork?

You can hire a Big Data Engineer near Chennai, on Upwork in four simple steps:

  • Create a job post tailored to your Big Data Engineer project scope. We’ll walk you through the process step by step.
  • Browse top Big Data Engineer talent on Upwork and invite them to your project.
  • Once the proposals start flowing in, create a shortlist of top Big Data Engineer profiles and interview.
  • Hire the right Big Data Engineer for your project from Upwork, the world’s largest work marketplace.

At Upwork, we believe talent staffing should be easy.

How much does it cost to hire a Big Data Engineer?

Rates charged by Big Data Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.

Why hire a Big Data Engineer near Chennai, on Upwork?

As the world’s work marketplace, we connect highly-skilled freelance Big Data Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Big Data Engineer team you need to succeed.

Can I hire a Big Data Engineer near Chennai, within 24 hours on Upwork?

Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Big Data Engineer proposals within 24 hours of posting a job description.

Looking to hire for long-term or full-time assignments? See how Full-time hiring on Upwork simplifies the process.