Search Jobs
Search by job, company or skills
Search by job, company or skills
Software
Job Description
Title: Senior Data Infrastructure Engineer
About the role
As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst and Operations teams to build and maintain a secure, scalable and reliable data platform that powers XXX Enterprise Data Hub. The position requires thorough working knowledge of public cloud, big data fundamentals, excellent programming skills, experience with relational & non-relational databases, containerization, IAM & networking security and troubleshooting.
What You'll Do
Responsible for building and managing our cloud infrastructure (AWS) with code first mindset.
Design and architect ETL/ELT pipelines running on AWS EMR and Snowflake
Performance tune data pipelines using technologies such as Apache Spark, Hive and Trino
Write and maintain high-quality code and participate in design discussions and code reviews.
Implement data storage solutions such as S3, ERDS and NoSQL databases.
Automate workflows using orchestration systems like airflow, oozie etc.
Build monitoring and observability dashboards.
Cost optimization and management.
Enforce security (create and maintain users and roles, assign privileges), establish procedures to ensure data integrity and availability.
Perform on-call duties to keep the lights up 24x7.
Setup and maintain documentation and standards.
About you
BS degree in Computer Science or equivalent
5+ years experience on public cloud such as AWS (preferred), Azure or GCP
Solid programming skills in Java or Python and Shell
Hands-on with Infrastructure as Code tools like Terraform or CloudFormation
Experience with performance diagnostics, debugging and performance tuning.
Familiarity with container software & platforms like Kubernetes, ECS etc.
Excellent verbal, written and interpersonal communication skills.
Login to check your skill match score
Date Posted: 24/10/2024
Job ID: 97789911
Greetings from TalentBasket!!
TALENTBASKET is a comprehensive Human Resource Training and Recruitment Group based in Kochi, with expertise in various aspects of Human Resource Management and its development. TALENTBASKET focuses on identifying and recruiting the best available resources in the country and also helps them utilize their skills and creative abilities, which will strengthen the Corporate Entity they are involved with.
