Senior Data Engineer

Deltatre

Early Applicant

5 months ago
Be among the first 50 applicants

Exp: 5-7 Years

Full time

Delhi, Hyderabad / Secunderabad, Telangana, Bengaluru / Bangalore, Chennai, Kolkata, Mumbai, Pune, India

Job Description

As a Senior Data Engineer in our Product team, the focus of your role will be to design, guide and deliver a highly scalable processing pipeline to support our new SaaS platform. You will be working with technologies such as Kafka, Flink, Spark, AWS and cloud-based database solutions, and will engage with high frequency data to support machine learning systems, in order to assist our clients increase engagement with end users. To be successful, you must be able to provide clear recommendations about future data related strategy that will enable the platform to evolve as we continue to grow.

You will be responsible for:

Curating data from our platform
Setting up and maintaining various pipelines on our bespoke platform within a cloud-based infrastructure
Working within a team environment to achieve team-based goals
Provide estimates and feedback to product owners for release scheduling purposes
Working closely with your peers to deliver quality software with amazing user experiences that solve real customer problems
Being a part of a fun, rewarding, innovative and results-driven culture

Requirements

Experience with Event-driven Micros-services architecture
Experience with Real-time and batch data processing at high scale
Apache Flink, KStreams, Kinesis, Kafka
AWS, Kinesis Data Analytics, Redshift, Glue, Lambda
Data Lake, Data Warehouse and ETL experience
Strong database knowledge (SQL / NoSQL)
Application Performance Monitoring
Docker and Kubernetes
CI/CD
Software Engineering experience (ideally Java and Python)

We re looking for someone who is:

driven to push the boundaries and lead change and performance
communicative to leave no-one in the dark and to work with your team successfully
reliable so we know that we can call on you to meet deadlines
passionate about the latest technologies and standards
proactive to suggest improvements, identify and fix potential issues
solid technically speaking, to advise both Clients and internal teams