• Implementing, managing and administering the overall hadoop infrastructure with various distributions (preferably Cloudera)

• Deploying a hadoop cluster, maintaining a hadoop cluster, adding and removing nodes using cluster monitoring tools like Ganglia Nagios or Cloudera Manager, configuring the NameNode high availability and keeping a track of all the running Hadoop jobs.

• Takes care of the day-to-day running of Hadoop clusters

• Experience with NoSQL databases, such as HBase, Cassandra, MongoDB or similar

• Experience with Big Data tools such as Pig, Hive, Impala, Sqoop, Kafka, Flume, Jupitor

• Experience with Hadoop, HDFS, Spark • Experience in Linux administration, Unix Shell Scripts

• Person will be responsible to Perform Hadoop Administration on Production/DR Hadoop clusters. • Perform Tuning and Increase Operational efficiency on a continuous basis

• Monitor health of the platforms and Generate Performance Reports and Monitor and provide continuous improvements

• Working closely with development, engineering and operation teams, jointly work on key deliverables ensuring production scalability and stability

Develop and enhance platform best practices • Ensure the Hadoop platform can effectively meet performance & SLA requirements

• Responsible for support of Hadoop Production environment which includes Hive, Ranger, Kerberos, YARN, Spark, SAS, Kafka,base, etc.

• Perform optimization, capacity planning of a large multi-tenant cluster.

• Identify, Implement and continuously enhance the data automation process.

• Participate in the architectural discussions, perform system analysis which involves a review of the existing systems and operating methodologies. Participate in the analysis of latest technologies and suggest the optimal solutions which will be best suited for satisfying the current requirements and will simplify the future modifications

• Extensive experience working with SQL across a variety of databases

• Experience working with both structured and unstructured data sources.