Role Title
Hadoop Administrator/Engineer - Enterprise Data and Analytics Enablement Reliability Observability & Compliance (ROC product area).
Product Context:
Our purpose is to shape a world where people and communities thrive, and to achieve this we need a talented EBD SRE to join our Enterprise Data and Analytics Enablement technology area for Reliability Observability and Compliance Product area. The Enterprise Data and Analytics Enablement technology area sits within our Cloud, Data and Analytics Domain and builds and operates our strategic on-premise Data Platforms.
What Does a day In The Life Look Like
- Design, build, test and support a secure, robust and scalable Data Ecosystem on the Big Data Platform
- Solving ambiguous and complex engineering problems
- Work collaboratively within and across teams, Tech Areas and Domains
- Utilise tools and practices to build, verify and deploy solutions in the most efficient ways, we place a high emphasis on Software Fundamentals
- Implements a culture within the Tribe and the Chapter, encouraging best practices around reviews, quality and documentation
- Support the day to day Big Data Platform (Hadoop) operations, while also driving continuous improvement initiatives for the platform.
Role Skills And Responsibilities
What will be in your toolkit
- You have developed a mastery in engineering related experience in software/IT industry
- You place a high emphasis on Software Engineering fundamentals such as code and configuration management, CICD/Automation and automated testing
- Technical lead experience with focus on implementing/supporting big data environments
- Strong Linux/Unix skills for large scale distributed systems
- Expertise in managing at least one commercial distribution of Hadoop (Preferably Cloudera CDH or CDP 7+).
- Expertise with Hive, YARN, Spark, Impala, Kafka, SOLR, Oozie, HDFS, Ranger, Encryption, Hbase, etc.
- You have experience in two or more of the following
- Working with operations, security, compliance and architecture groups to develop secure, scalable and supportable solutions
- Supporting and monitoring a complex data ecosystem
- Working and delivering solution in a complex enterprise environment
- Optimization, capacity planning & architecture of a large multi-tenant environment.
- Experience of working in an agile environment
- Good understanding on DNS, AD, Kerberos
- We expect out senior people to help develop, inspire, mentor and coach other team members
- Growth mindset with a proven ability and to solve ambiguous and complex problems
- Desire and ability to own and deliver outcome, we highly value people that can work autonomously
- Ability to build and maintain relationships and influence outcomes when required
- #IN-CDL