Job Description
Job code: 2097598
Primary Skills: Pyspark, performance tuning, cluster log analysis,NiFi, Hive, Hbase, Kafka, Spark Streaming.
Notice period: immediate to 30 Days Joiners
Location: Pune/Chennai/Bangalore/Hyderabad/ Mumbai/ Gurgaon
Band: B3
Job Description
Band B3
Relevant Exp 6 to 9 Years
Offshore Data Engineers Cloudera Focus (x 3 )
Focus: Hands-on analysis, performance tuning, cluster log analysis
Responsibilities
Execute data analysis tasks guided by the architect and lead. (cluster/process log analysis, code profiling, metrics gathering).
Analyze Hive, Spark, Kafka, Hbase, spark streaming processes for identifying performance improvement opportunities
Recommended optimizations for data storage, Hbase, HDFS.
Assist with migration impact analysis and data transfer tasks (if applicable).
Qualifications
6 to 9 years experience with Cloudera stack (Spark, NiFi, Hive, Hbase, Kafka, Spark Streaming).
Proven experience in doing performance improvement on hive, spark jobs.
Ability to evaluate existing jobs with critical mindset to find areas of improvement.
Strong Scala/Python programming skills for data engineering.
Team-oriented, able to work effectively under the guidance of senior team members.
