Hire the best Big Data Engineers in Chennai, IN

Check out Big Data Engineers in Chennai, IN with the skills you need for your next job.
Clients rate Big Data Engineers
Rating is 4.8 out of 5.
4.8/5
based on 294 client reviews
  • $60 hourly
    Senior Software Engineer with 7 years of experience in functional programming, machine learning, AI & BigData. Also got front-end experience building websites and tools.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Functional Programming
    React
    Apache Kafka
    Akka
    Apache Cassandra
    Amazon DynamoDB
    Databricks Platform
    Machine Learning
    Apache Spark
    Python
    Scala
    JavaScript
  • $80 hourly
    I have around 20 years of software development experience using Java and Python. Throughout my career I have worked in different startups which were at different stages. Languages used: Java, C, Python Tools/Frameworks: Apache Hadoop, Hive, Spark, Spring boot, Apache tomcat, Apache Airflow, Apache Falcon, Apache Oozie, Flask, React JS, Python pandas, Kubernetes Cloud technologies: AWS Elastic Beanstalk, AWS Lambda, Athena, AWS S3, Amazon Redshift, AWS Managed airflow, EKS, MSK, Snowflake Operating system: Unix, Linux( Redhat, Ubuntu, Centos, Fedora) IDE: Eclipse, Intellij Experience in building applications in NMS/EMS, Online video advertising, Big data, Recommendation systems domains. Worked in building DSP, RTB bidders, Ad network, SSP & Ad Exchange integrations for video advertising using OpenRTB delivering ads through VAST inline, wrappers responses. Frequency capping, pacing, budgeting, forecasting, day parting, user/cookie sync, targeting (geo,content,site/app,publisher,time,segment) Programming experience in backend API and Big data application development. Good knowledge in AWS cloud solutions like EC2, S3, Elastic Beanstalk, Lambda, Redshift. Worked closely with the application development team and the data science teams to integrate the machine learning models in the production system. Has experience in leading a highly collaborative engineering team. Built data platform, data pipelines for processing a large volume of data using big data technologies. Have experience in building systems that can handle billions of requests per day
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Management
    Apache Hive
    Core Java
    Web Crawling
    Spring Boot
    ETL Pipeline
    API Development
    Apache Airflow
    pandas
    Apache Spark
    Python
  • $80 hourly
    This is Raj, CEO from BICS GLOBAL. I am 10+ years of experience in Software development and 8+ years of experience in salesforce implementation and Salesforce Integration. SALESFORCE SPECIALTIES 💎 Salesforce® Consulting 💎 Salesforce® Implementation 💎 Salesforce® Integration 💎 Salesforce® AppExchange 💎 Salesforce® Lightning 💎 Salesforce® CPQ 💎 Salesforce® Einstein MARKETING CLOUD SPECIALTIES 💎 Exact Target 💎 Pardot 💎 HubSpot 💎 Adobe Campaign Management 💎 MailChimp 💎 Eloqua 💎 Marketo ✅ Years of experience working in the Information Technology field covering requirements gathering, process analysis, application design, testing, project management, business intelligence, application development and IT service management. ✅ Solid Project Development and ERP/CRM experience in delivering IT solutions to meet end-user expectations and business objectives. ✅ Strong technical background and ability to effectively brainstorm solution options with technical resources to deliver client’s requirements. ✅ Adequate knowledge of the latest Data solutions and technologies along with their usage context. ✪✪ Experienced in SalesForce.com Apex Classes, Apex Triggers, Visual Force, Custom components, Custom Settings, Force.com API. Hands on experience in developing and deploying custom integration Salesforce.com CRM solutions. ✪✪ Experienced in Salesforce1, Salesforce Mobile Development, Lightning, Experienced with single sign on implementation. ✪✪ Extensive experience in designing custom objects, custom field, picklist, role based layouts, Workflow Alerts and Actions, and Approval Workflow, Validation Rules, Approval processes, Custom Tabs, Custom report, Report folder, report extractions to various formats, design of Visual Force Pages, Snapchat, Dashboards, and Email generation according to the application requirements. ✪✪ Hands on experience with Profile, Permission Sets, organization Wide Defaults and Roles. ✪✪Experienced customizing standard objects Accounts, Contacts, opportunities, products, price books, Cases, Leads, Campaigns, Report and Dashboards Requirement Gathering. ✪✪ Design and configure Salesforce solutions using Marketing Cloud Social Studio, Email Builder, Journey Builder, Salesforce Admin, Pardot, HTML and CSS skills, Proficient in Amp scripting and content builder
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Salesforce Marketing Cloud
    Salesforce App Development
    Business Intelligence
    Tableau
    Apex
    Mobile Development Framework
    Magento
    Salesforce CRM
    Mobile App Development
  • $30 hourly
    Seasoned data engineer with over 11 years of experience in building sophisticated and reliable ETL applications using Big Data and cloud stacks (Azure and AWS). TOP RATED PLUS . Collaborated with over 20 clients, accumulating more than 2000 hours on Upwork. 🏆 Expert in creating robust, scalable and cost-effective solutions using Big Data technologies for past 9 years. 🏆 The main areas of expertise are: 📍 Big data - Apache Spark, Spark Streaming, Hadoop, Kafka, Kafka Streams, HDFS, Hive, Solr, Airflow, Sqoop, NiFi, Flink 📍 AWS Cloud Services - AWS S3, AWS EC2, AWS Glue, AWS RedShift, AWS SQS, AWS RDS, AWS EMR 📍 Azure Cloud Services - Azure Data Factory, Azure Databricks, Azure HDInsights, Azure SQL 📍 Google Cloud Services - GCP DataProc 📍 Search Engine - Apache Solr 📍 NoSQL - HBase, Cassandra, MongoDB 📍 Platform - Data Warehousing, Data lake 📍 Visualization - Power BI 📍 Distributions - Cloudera 📍 DevOps - Jenkins 📍 Accelerators - Data Quality, Data Curation, Data Catalog
    vsuc_fltilesrefresh_TrophyIcon Big Data
    SQL
    AWS Glue
    PySpark
    Apache Cassandra
    ETL Pipeline
    Apache Hive
    Apache NiFi
    Apache Kafka
    Apache Hadoop
    Scala
    Apache Spark
  • $30 hourly
    Snowflake Certified Developer (SnowPro).  Excellent experience in data processing using Python in Databricks Platform  Good understanding of Pyspark concepts  Excellent experience in features like Snowpipes, Stages and Tasks using Python.  Excellent experience in Loading / Unloading data using internal and external Stages  Excellent experience in working with Streamsets – Data Collector and Transformer  Excellent experience in integrating Streamsets with - Amazon Cloud Products like ( but not limited ) S3, Redshift , Athena, Delta Lake Note: I have worked projects where ever complex SQL queries are used. I have developed SQL queries which ran more than 1K lines. Spent most of my career in extracting and validating data using SQL queries , no matter the underlying database is.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Oracle PLSQL
    Docker
    Data Curation
    Oracle Database Administration
    Apache Kafka
    Linux
    Databricks Platform
    Apache Spark
    Data Analysis
    Amazon Web Services
    Data Warehousing & ETL Software
    Data Extraction
    Data Ingestion
    Data Model
    Data Lake
    Hive
    dbt
    SQL Programming
    Snowflake
    Data Processing
    Data Engineering
    SQL
    Data Migration
    Oracle Database
  • $49 hourly
    I am an innovative and experienced AI Research Scientist with a passion for solving complex problems and delivering cutting-edge AI solutions. My extensive background in machine learning, deep learning, and data science enables me to create high-impact, tailored solutions for diverse industry needs. I am committed to helping clients achieve their goals by leveraging state-of-the-art AI technologies and best practices. My core expertise includes: 1. Machine Learning and Deep Learning: Proficient in various ML and DL algorithms, including supervised, unsupervised, and reinforcement learning techniques. Skilled in designing and implementing custom models for a wide range of applications. 2. Natural Language Processing and Computer Vision: Expert in developing advanced NLP and computer vision solutions, such as sentiment analysis, chatbots, object detection, and image recognition. 3. AI Frameworks and Libraries: Highly experienced with popular AI frameworks and libraries, including TensorFlow, Keras, PyTorch, and scikit-learn, allowing for efficient model development and deployment. 4. Python Programming: Adept at writing clean, efficient, and well-documented Python code to implement AI algorithms, process and analyze data, and develop custom software solutions. 5. Data Science and Analytics: Strong background in data preprocessing, feature engineering, and statistical analysis to support AI model development and optimization. 6. AI Ethics and Bias Mitigation: Committed to ensuring AI solutions are developed responsibly, with a focus on reducing bias, ensuring transparency, and maintaining ethical standards. 7. Big Data and Cloud Computing: Experienced with big data processing tools like Hadoop and Spark, as well as cloud computing platforms like AWS, GCP, and Azure for scalable AI solutions. 8. AI Project Management and Strategy: Skilled in managing AI projects from ideation to deployment, ensuring successful and timely delivery while maintaining clear communication with clients and stakeholders. Whether you require an AI-powered recommendation system, an intelligent chatbot, or a custom deep learning solution, I am dedicated to providing top-notch AI services to help you stay ahead in the rapidly evolving world of artificial intelligence. Let's work together to turn your AI vision into reality!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Algorithm Development
    Artificial Intelligence
    Computer Science
    Project Management
    Certified Associate in Python Programming
    Deep Learning
    TensorFlow
    Computer Vision
    Data Science
    PyTorch
    Machine Learning
    Natural Language Processing
  • $100 hourly
    PROFESSIONAL SUMMARY * A successful IT Professional, 13+ years of experience in Informatica PowerCenter, SSIS,Hadoop,Hive,Spark,Scala,Python and GCP with a strong background in data warehouse and in reporting process. * Experienced in troubleshooting Oracle, Teradata scripts, fixing bugs and addressing production issues and performance tuning * Strong experience in Database, Data warehouse and ETL concepts. * Experience with Informatica Advanced Techniques - Dynamic Caching, Memory Management, Parallel Processing to increase Performance throughput. * Extensively involved in Optimization and Tuning of mappings and sessions in Informatica by identifying and eliminating bottlenecks, memory management and parallel threading. * Good experience in Performance tuning, Partitioning and implementing Parallelism at Informatica and database level.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    SQL Programming
    Apache Hive
    Apache Hadoop
    Python Script
    Unix System Administration
    Hive
    Apache Solr
    SQL
    Unix
    Python
    Informatica
  • $50 hourly
    - A seasoned software engineer with a decade-long experience in designing, developing, documenting, maintaining, and debugging enterprise software. - Forte in developing features and debugging issues inside a complex technology stack. - Experience in Distributed and Multi-threaded Systems. I was a founding team member (early/ first Indian employee) of Striim, a technology company that offers a unified platform for real-time data integration and data intelligence/analytics. I've worked on depth and breadth of this product. If you're looking for a backend engineer, who is a fast learner and open to new technologies, to build your software then I can help.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Database
    Back-End Development
    Software Debugging
    Core Java
    Data Integration
    Multithreaded, Parallel, & Distributed Programming Language
    Java
    Distributed Computing
  • $60 hourly
    I'm a dedicated Computer Science and Engineering (CSE) student freelancing with a keen interest in diverse projects. Proficient in programming languages, web development, and software applications, I bring a strong academic foundation to every task. Adaptable and deadline-driven, I excel in delivering high-quality work while staying attuned to industry advancements. My commitment to continuous learning ensures I tackle challenges with innovative solutions. With a passion for elegant code and user-centric design, I'm ready to contribute my skills to any project in the dynamic world of CSE freelancing.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Content Writing
    AI Content Writing
    HTML5 Boilerplate
    Database Management System
    Python
    JavaScript
    HTML
    Data Science
    Computer Network
    Machine Learning
    C
    Web Application
    Data Analytics
    Web Development
  • $25 hourly
    Solution Architect proficient at hands-on coding, designing, and implementing effective technical business solutions. Advanced level of technical knowledge combined with sound business vision and coding skills. Exceptional problem-solving, written and verbal communication skills, with a broad understanding of UML, databases, SOA/EAI, and related applications. Enjoy leading a team to deliver end-to-end solutions to customers—hands-on experience in end-to-end Microservices Architecture and Cloud (AWS). • Sun Certified Java Programmer (SCJP) • Sun Certified Web Component Developer (SCWCD) • Sun Certified JCAPS Integrator • Sun Certified Developer for Java Web Services 5 (SCDJWS) • Certified BIG DATA Developer (Hadoop, PIG, Hive, HBase) • AWS Certified Solutions Architect - Associate
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Solution Architecture
    Web Services Development
    iBATIS
    Spring Framework
    Hibernate
    Spring Security
    Java
    Microservice
  • $20 hourly
    I am an aspiring data scientist who enjoys connecting the dots: be it ideas from different disciplines, people from different teams, or applications from different industries. I have strong technical skills and an academic background in engineering, statistics, and machine learning. My passion lies in solving business problems with tailored data and algorithms and communicating complex ideas to non-technical stakeholders. I am able to jump across verticals to deliver high-performing business solutions. Please feel free to get in touch with me via email at quasarkaruna10@gmail.com Proficient: Python (scikit-learn, NumPy, SciPy, pandas), TensorFlow, Excel Domain expertise: Healthcare , Finance Knowledgeable: SQL, Spark (Spark SQL, MLLib, Pyspark) Familiar: NLP (Natural Language Processing), Finance
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Web Scraping
    Microsoft Azure
    Analytics
    SQL Programming
    Data Engineering
    Data Labeling
    Data Mining
    Data Science Consultation
    Python
    Machine Learning Model
    Data Science
  • $9 hourly
    I am a Ai developer with the expertise in the neural network and I have worked for the company to automate the some commercial bank operations using the chatbot (NLP) ,natural language processing is one of my specialty. INDUSTRY PROJECTS • Intern at TTF powered by Temenos (T24) Developed an Advanced Ai chatbot to automate the commercial banking operations (Dur: 2month) • Intern at TCS NLP (Dur: 2month) • Intern at NeoDocta Data Analyst (Dur: 6month) • Intern at Benz Data Analyst (Dur: 1month) • Intern at MCW (Dur:2 years) SKILLS PROGRAMMING Java • Python • R • php • C Exams MongoDB certified Associate Developer Azure certified Associate Ai and Ml engineer Familiar Software: Robodk(cad) • PowerBI • Tableau • MySQL• MongoDB• Hadoop Azure, Mongo DB atlas, Aws Knowledge: Machine Learning Algorithms Deep learning Algorithms Data Structures Data Mining Robotics Big Data Analytics
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Mining
    Analytics
    Algorithm Development
    MongoDB
    Artificial Intelligence
    Deep Tone
    Data Analytics
    Apache Hadoop
    Deep Learning Modeling
    MySQL Programming
    Deep Neural Network
    Deep Learning
    Machine Learning Model
  • $5 hourly
    👋 Greetings! I'm an aspiring Software Engineer keen to embark on a journey into the realms of Big Data and SQL. As a newcomer to the industry, I'm eager to learn, grow, and make a meaningful impact. 🌐 Skills: ✅ Big Data Enthusiast: I'm excited about delving into Big Data technologies like Hadoop and Spark. ✅ SQL Apprentice: I'm venturing into the world of SQL databases with a thirst for knowledge. 💼 Why Choose Me: ✅ Passion for Learning: I'm committed to expanding my skills and knowledge to meet your project requirements. ✅ Dedication: I'm prepared to put in the hard work to deliver quality results. 💬 Let's Get Started: I may be new, but I'm ready to contribute and learn alongside your project. Let's start a conversation about how I can support your needs. Best, Gopi Krishna
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Snowflake
    AWS CloudTrail
    Hive
    Microsoft Power BI
    Scala
    MongoDB
    Java
    Apache Spark
    SQL
  • $15 hourly
    Experienced Data Engineer with a keen ability to interpret and analyze data, contributing to the successful implementation of business solutions. Proficient in the end-to-end development of analytical applications and reports.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Flask
    MySQL
    PostgreSQL
    Batch Processing Framework
    Online Analytical Processing
    Data Analysis
    Data Cleaning
    API
    ETL
    Data Warehousing
    SQL
    Python
  • $10 hourly
    • Development and Implementation of various methods to load HIVE tables from HDFS and Local File System • Good knowledge on Hive Queries to parse the raw data, populated external & managed tables and store the refined data in partitioned external tables. • Creating Hive tables and working on them using Hive QL. • Experience in working with the Different file formats like TEXTFILE, ORC, Parquet and JSON. • Good experience in writing spark applications using python. • Implemented pre-defined operators in spark such as map, flatMap, filter, reduceByKey, groupByKey. • Implemented spark using scala, and utilizing Data Frames and Spark SQL API for faster processing of the data instead of mapreduce. • Good experience in loading the data into Spark RDD and do in memory data computation and generate output response. • Good working knowledge of Spark core (RDD) and Spark SQL (Data frames).
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Python Script
    ETL
    Data Transformation
    Marketing
    HDFS
    Amazon Redshift
    Amazon S3
    Snowflake
    Hive
    PySpark
    Python
  • $5 hourly
    technology Low price freelancer Ui designers Website design business analyst Dashboard Bie Datas data analyst ark. IBM Analyzing Sql in Big dats , Cloudera
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Machine Learning
    Microsoft Power BI
    UI/UX Prototyping
    Microsoft Office
    Python
  • $50 hourly
    I am a Big Data developer having 11 years of experience in hadoop and its ecosystems like HDFS, Mapreduce, Hive, Impala, Oozie, Spark with Scala (CDH and Azure Databricks distributions)  A self-motivated and goal oriented individual with good Analytical problem solving skills
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Azure App Service
    Databricks Platform
    SQL
    Unix
    Apache Impala
    Hive
    Scala
    Apache Spark
    Apache Hadoop
  • $13 hourly
    I'm Vijay Karthick, a budding Data Scientist and Analyst enthusiastic about delving into the realms of data exploration and analysis. Though I'm a newcomer to the professional scene, my practical experiences and dedication equip me with a solid foundation to tackle challenges and contribute meaningfully to projects. Top Skills: Data Analysis: Proficient in utilizing statistical methods and machine learning algorithms to extract insights from data sets. Machine Learning: Skilled in implementing various machine learning techniques such as regression, classification, clustering, and neural networks to solve real-world problems. Data Visualization: Skilled in creating clear and engaging visual representations of data to facilitate understanding and decision-making. Programming: Proficient in languages such as Python, R, and SQL, enabling effective data manipulation and analysis. Problem-Solving: Adept at identifying and addressing challenges through analytical thinking and creative solutions. Continuous Learning: Committed to staying updated with the latest tools and techniques in data science through self-study and online courses. Experiences: Academic Projects: Spearheaded various data analysis projects during my academic journey, including predictive modeling and sentiment analysis. Internships: Gained hands-on experience through internships where I applied data analysis techniques to real-world problems. Personal Projects: Developed and implemented personal projects to explore new concepts and enhance my skills in data science and analysis. Interests: Exploring emerging trends and technologies in the field of data science. Collaborating with peers on projects that challenge and expand my analytical capabilities. Contributing to online communities and forums to share knowledge and learn from others in the field. I am driven by a passion for unraveling insights from data and a desire to make a meaningful impact through my work. I eagerly look forward to opportunities to grow and thrive in the dynamic world of data science. Let's connect and embark on this exciting journey together!
    vsuc_fltilesrefresh_TrophyIcon Big Data
    PyTorch
    TensorFlow
    Jupyter Notebook
    Data Visualization
    Microsoft Power BI
    SQL
    Database
    Deep Learning
    Statistical Analysis
    Python
    Data Science
    Data Analytics
    Data Analysis
    Machine Learning
  • $30 hourly
    Zeptoh is an Software Development and Testing services company. Our Team has an extensive experience on wide range of skill set, roles and verticals. We are Proficient in analyzing and translating business requirements to technical implementations and architecture. Good exposure in Java, JavaScript, UI/UX, Web and Mobile based Application development. Extensive experience with Analysis, Design, Development & Testing on Software Product/Services based Applications. We have experience in on-site/off-shore communication with the customers on various stages. Our Testing team has good knowledge on QA platform involving various types of testing like Functional, Load, Performance, Data driven, keyword testing and Production monitor. Please connect with me in skype using id "ev_irtt" to discuss further.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Java
    JavaScript
    Android
    Node.js
    iOS Development
    Distributed Computing
    Automated Testing
    HTML5
    AngularJS
  • $999 hourly
    As a college student, i have a skill set that can be highly valuable in the freelance marketplace. With expertise in biology, computer science, and statistics, I'm equipped to analyze complex data and create computational models. As a freelancer, i can work remotely, set my own hours, and choose the projects that interest me the most. With a strong work ethic, attention to detail, and a passion for science,data,web design.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Medical Informatics
    Python Script
    SQL
    UI Animation
    Graphic Design
    Translation
    Bioinformatics
    Editing & Proofreading
  • $40 hourly
    I am a professional with around 13 years of experience in software engineering, with substantial expertise in Big Data technologies. * Good experience in Spark, NoSQL, Kafka, Spark Streaming, Hive, and MySQL. * Good experience in Python & have basic knowledge in Core Java and Golang. * Big Data Development, Data Modeling, end-to-end data Orchestration frameworks, and Business Intelligence Reporting. * Directing the full development cycle of solution designing, development, testing, deployment, and documentation for complex projects and products in the domain of data analytics; built and delivered comprehensive data strategy road map; ensured final deliverables were of the highest quality. * Proficient with Batch Data Processing, Real Time Streaming, and Data Cleansing and Data quality checks.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Apache Hadoop
    Java
    MySQL
    Apache Cassandra
    Apache Kafka
    Golang
    Python
    Apache Hive
    Apache Spark
    Problem Solving
    Architectural Design
    Data Engineering
    Solution Architecture
  • $20 hourly
    Professional with 8 years of experience in Predictive analytics, statistical modelling, inventory management, forecasting, product implementation with a recent focus thought leadership and project management across ecommerce, retail and pharmaceutical, bridging the gap between the business and technical side. Goal oriented, data-driven problem solver and a quick learner
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Data Analytics
    Test Results & Analysis
    Testing
    Software QA
    Analytics
    Graph
    Information Analysis
    Data Analysis
  • $10 hourly
    Having a decade of experience in Data Analytics, Business Intelligence, Data Warehousing, Power BI, Power Automate. I can help you build an Software application, Dashboards etc.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Microsoft Power Automate
    Data Warehousing & ETL Software
    Google Cloud Platform
    Analytics
    Microsoft Power BI
    Looker
    BigQuery
    Business Intelligence
    Data Analytics
  • $10 hourly
    I am expertise in design, build, and maintains systems that handle large volumes of data. To create efficient data pipelines, ensure data quality, and optimize performance to support data-driven decision-making within an organization. Required skills include programming also knowledge of databases and cloud platforms, and attention to data security and compliance.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Microsoft Azure
    Google Cloud Platform
    SQL
    Unix Shell
    Python
  • $20 hourly
    Profile Enthusiastic Mathematics graduate with a keen interest in Data Science. Currently pursuing an MSc in Data Science, specializing in advanced statistical analysis and machine learning techniques. Skilled in Python, SQL, and data visualization tools.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Microsoft Power BI
    Python
    SQL
    Machine Learning Model
    Machine Learning
    Data Science
  • $20 hourly
    Software Engineer with 10 years of professional experience in the programming languages Python, Scala, Mainframe COBOL and in the processing engine in Spark and Pyspark codes. Have experience in GCP cloud. Good Experience in Shell scripting and python scripting also
    vsuc_fltilesrefresh_TrophyIcon Big Data
    Oracle
    SQL
    BigQuery
    C
    PySpark
    Scripting Language
    COBOL
    Apache Hadoop
    Hive
    Apache Spark
    Scala
    Python Script
    Python
  • $5 hourly
    Skills and Experience Summary: • Overall 19 years of experience in IT industry, strongly focusing on providing solution and delivery in the areas of core application implementation using Java, Big Data Technologies and microservices datastore in NoSQL database technologies like MongoDB, Cassandra and Couchbase. • Having 5 years of experience in Big data using Hadoop eco systems and 2 years of experience in NoSQL database technologies. Big data Hadoop and Eco Systems: • Experienced with Data Ingestion, Storage, Querying, Processing and Analysis of Big Data using Hadoop Ecosystems including HDFS, Hive, Hbase, Oozie and Spark. • Good knowledge on Big Data and Analytics landscape. • Exposure and experienced in industry leading Hadoop distributions. (HDP, now merged with Cloudera) • Built a home grown Enterprise Data Platform solution (EDP) with ingestion, transformation layers. The data is being ingested from various data sources, transformed and stored in common data repository. NoSQL Database Technologies: • Experience in NoSQL database technologies like MongoDB, Cassandra and Couchbase. • As a data architect, involved in laying out data strategy for microservices architecture comprising of analysis and recommendation of microservices data store, data modelling and managing CI/CD pipeline. • Involved in architecture discussions and presentation of solutions to management. • Built a techno commercial proposal to management based on technical and cost proposal discussions with each of the vendor.
    vsuc_fltilesrefresh_TrophyIcon Big Data
    AWS Lambda
    AWS Glue
    Scala
    Apache Spark
    Java
  • Want to browse more freelancers?
    Sign up

How hiring on Upwork works

1. Post a job (it’s free)

Tell us what you need. Provide as many details as possible, but don’t worry about getting it perfect.

2. Talent comes to you

Get qualified proposals within 24 hours, and meet the candidates you’re excited about. Hire as soon as you’re ready.

3. Collaborate easily

Use Upwork to chat or video call, share files, and track project progress right from the app.

4. Payment simplified

Receive invoices and make payments through Upwork. Only pay for work you authorize.

Trusted by

How do I hire a Big Data Engineer near Chennai, on Upwork?

You can hire a Big Data Engineer near Chennai, on Upwork in four simple steps:

  • Create a job post tailored to your Big Data Engineer project scope. We’ll walk you through the process step by step.
  • Browse top Big Data Engineer talent on Upwork and invite them to your project.
  • Once the proposals start flowing in, create a shortlist of top Big Data Engineer profiles and interview.
  • Hire the right Big Data Engineer for your project from Upwork, the world’s largest work marketplace.

At Upwork, we believe talent staffing should be easy.

How much does it cost to hire a Big Data Engineer?

Rates charged by Big Data Engineers on Upwork can vary with a number of factors including experience, location, and market conditions. See hourly rates for in-demand skills on Upwork.

Why hire a Big Data Engineer near Chennai, on Upwork?

As the world’s work marketplace, we connect highly-skilled freelance Big Data Engineers and businesses and help them build trusted, long-term relationships so they can achieve more together. Let us help you build the dream Big Data Engineer team you need to succeed.

Can I hire a Big Data Engineer near Chennai, within 24 hours on Upwork?

Depending on availability and the quality of your job post, it’s entirely possible to sign up for Upwork and receive Big Data Engineer proposals within 24 hours of posting a job description.