The engineer will ensure the data standards, data availability, Release management, build and maintain data pipelines and fully support the goals of GDIA and the enterprise
- 2+ years of experience in managing and deploying data pipelines
- 2+ years of experience in Python development
- Exposure to GCP Technologies
- Ability to write complex SQL queries needed to query & analyze data
- Knowledge of data management standards, data governance practices and data quality
- Good Problem solving skills
- Strong Oral and written communication skills
- Perform production monitoring of sources assigned to product team
- Create incidents for production failures
- Perform analysis and immediate fix (non code fixes) for the incidents
- Create problem tickets and work with Product manager to create features for production issues requiring permanent fixes
- Perform Production deployment (upon receiving KT and access) for the product team
- Perform performance tuning of data pipelines
- Maintain and monitor data pipelines; fix recurring issues and deeper data problems
- Address and fix Vulnerability issues in data pipelines
- Proactively create alerts and notifications for identifying potential issues
