Hadoop, Spark & Cassandra Developer
4+ years of Experience in Big Data domain with tools like Hadoop (CDH ), Spark and other open source tools/technologies in Healthcare, Benefits and Ecommerce.
Excellent Java development skills using Core Java, Servlets, JSP , JDBC, Java Beans.
Substantial experience in writing Apache Spark jobs in Scala and MapReduce jobs in Java, Sqoop, Flume, Zookeeper, HBase and Hive .
Hands on experience in installing, configuring and using ecosystem components like Hadoop MapReduce, HDFS, Hbase , Zookeeper, Oozie, Hive, Sqoop, Flume.
Extensive experience in SQL and NoSQL development.
Experience in data analytics using Apache Spark in Scala.
Knowledge of Apache Spark SQL and Spark Streaming.
Understanding of Big Data Concepts and Hadoop related technologies i.e. Hive,Sqoop, Flume, Hbase, ZooKeeper, Yarn, MapReduce, Apache Spark
Extensive Object Oriented Development OOP/OOD experience.
Experience encompasses software design, development and maintenance of custom application software.
Strong database connectivity skills with MySQL, Access.
Worked on Distributed/Cloud Computing using (Apache Spark,MapReduce,Hbase, Yarn,,Zookeeper, etc.)
Working in implementing Hadoop with the AWS EC2 system using a few instances in gathering and analyzing data log files.
Working on data using Sqoop from HDFS to Relational Database Systems and vice-versa.
Working on Hive/Hbase vs RDBMS, imported data to Hive, partitions, indexes, views, queries and reports for BI data analysis.
Developing data pipeline using Flume, Sqoop, Pig and Java map reduce to ingest customer behavioral data and benefits histories into HDFS for analysis.
Worked on RDDs and aggregate functions applied on them to get the required results.
Working as a Implementation Analyst for configuring the benefits and events based on the BRD documents and processing them
Involved in various phases of Software Development Life Cycle (SDLC) as requirement gathering, data modeling, analysis, architecture design and development of project.
Worked on XML schema and SOAP message.
Developed business logic activities by developing business service classes.
Involved in web development using RoR technologies.
Worked on different gems for authentication, building role base systems.
Worked on Integration with other api and consuming their apis e.g. Twitter , LinkedIn, Facebook and Instagram
Worked on integrating different payment system with the web applications e.g. PayPal, Authorize.ent, Heartland , Braintree etc.
Experienced in deploying the Rails web app to VPS server e.g. Linode, Digital Ocean, Amazon EC2 , Rackspace etc with the apache passenger and ngnix server.
Worked on writing the deployment scripts and cron schedulers.
Worked on Redis and elastic search .