Senior Data Engineer

This role is for a Senior Data Engineer with 4 to 6+ years of solid development experience who will focus on creating robust data pipelines and enhancing existing ETL processes. You will be an integral part of development team examining requirements and designing optimal solutions. The role is for a self-motivated individual with knowledge of Hadoop ecosystem and various Hadoop tools/services. The candidate will perform hands-on activities including design, documentation, development and test of new functionality.

If this excites you, we want to chat and discuss our work culture and environment and see if this will be a good fit for both of us.

Location Hyderabad/Bangalore/Mumbai/Gurgaon

Experience Level 4+ years of relevant work experience with a bachelors degree or masters degree, or a PhD.

Preferred Qualifications:

• Excellent coding skills in Java/Scala/python especially in OOP constructs & concurrency systems; experienced in building highly optimal software systems.
• Strong experience with Azure
• Well versed in shell scripting for working on Unix/Linux based systems.
• Experience in designing, building, tuning & troubleshooting distributed, scalable data pipelines & data streaming solutions
• In depth knowledge and hands-on experience of

Skills:

• Hadoop based computing solutions including but not limited to MapReduce, Spark, Hive, Tez, YARN, HBase, Kudu, Druid, Presto, Impala
• Building real time streaming solutions including but not limited to Kafka, Spark Streaming, Structure Streaming, Apache Flink, Apache Beam, NiFi
• Distributed search systems like Solr, Elastic Search
• Distributed Memory Grid like Ignite, Redis, Hazelcast