Job opportunity for data engineers for Gurgaon location
Experience: 5+ years
Should have good experience in AWS cloud platform.
Role & Responsibilities Overview:
- A seasoned data team member with a good grasp of both business and technical aspects. Familiarity with data stack
- Interact with the other members of the data governance team,business teams to understand requirements and also collaborate with stewards / data custodians end users etc
- Demonstrated experience of building efficient data pipelines using tools or technologies likeSpark, Cloud native tools like EMR, Azure data factory, Informatica, Abinitio etc.
- Understand the need for both batch and stream ingestion of the data from source databases like SQLServer, Oracle, MySQL etc. and build scripts logics for reusable data transformations.
- Specialize in performance tuning of parked jobs, Databricks clusters and ETL processes leveraging advance features to enhance overall system efficiency.
- Conduct code reviews to ensure adherence to best practices, coding standards within Databricks notebooks and scripts.
- Lead Data Engineering Projects to manage and implement datadriven communication systems
- Proficient in data engineering , data management principles
- Good combination of technical skills, communication skills, and business acumen.
