Skills:
Big Data, hadoop, Kubernetes, cloud, Application Support, Hive, spark,
Position: L2 Support Engineer for OTT Media Operations
Relevant Experience: 8 to 16 years in Application Operations support
Experience in providing technical leadership in the Big Data space (Hadoop Stack like Spark, M/R, HDFS, Hive, storm, Flink, Spark, Kafka)
Experience in Administer tools involving stream processing and batch processing.
Experience building and optimizing big data data pipelines, architectures, and workflow (Luigi, Airflow, etc.)
Monitor and report on Hadoop resource utilization and troubleshoot.
Support code deployments (Spark / Flink jobs / Python jobs) into the Hadoop cluster
Hands on Experience in Kubernetes Cluster, CI-CD pipe line, Automations.
Experience on Application Monitoring Tools & Configuration.
Hands on Experience on any Cloud (GCP, Azure or AWS)
Certification on Cloud / Kubernetes/ Big Data will be added advantage.
Need to work in rotational shift including 4 to 6 Night shift per month.
Responsibilities
- Application and the involved technology component End to End Understanding
- Configure & improve monitoring for the Applications to ensure KPI availability.
- Resource management in a cluster environment. This involves new node creation and removal of unused ones.
- Performance monitoring and fine tuning on actual basis.
- Automation to reduce manual actions on systems.
- Security compliances of the Applications
