Lead Hadoop Admin

Location: Foster City CA (Onsite Hybrid) Duration: 12+ Months

Key skills required for Lead Hadoop Admin:

• Hadoop (preferably Hortonworks/Open Distribution), HDFS, Hive, Kafka, Spark, Oozie/Airflow, HBase
• Intermediate proficiency in SQL & HQL
• Solid understanding of Linux, and scripting skills would be advantageous
• Experience with Kerberos, TLS, Ranger, and data encryption

Job Description:

• Basic to intermediate experience with Spark
• Good experience with SQL. Should be able to understand and implement performance optimization
• Memory management experience
• Queue allocation, distribution experience in Hadoop/Cloudera environments
• Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments
• Good with one programming language
• Good exposure to Hive and Hadoop systems with exposure to monitoring tools. Sqoop, Oozie and other external tools
• Familiar with patch upgrades