Job Description
Role : Data Engineer
Location : India / remote // C2H
Must Haves
7+ years of experience as a Data Engineer
Advanced experience building Databricks platforms
Advanced experience with SQL and Python
Experience pulling data from SAP
Advanced experience with Azure synapse
Experience with Azure DevOps, GitHub, and CI/CD pipelines
Strong communication skills and ability to present conceptual and technical improvements to influence decisions
Plusses
SAC (SAP Analytics cloud) downstream ability to make data available for the visualization team, they will not be building visualizations
PowerBI ability to make data available for the visualization team, they will not be building visualizations
Data Sphere
Azure data factory (ADF)
Job Responsibilities
Responsible to design, build, refactor, and maintain data pipelines using Microsoft Azure, SQL, Azure Data Factory, Azure Synapse, Databricks, Python, and PySpark to meet business requirements for reporting, analysis, and data science
Responsible to teach, adhere to, and contribute to DataOps and MLOps standards and best practices to accelerate and continuously improve data system performance
Responsible to design, and integrate fault tolerance and enhancements into data pipelines to improve quality and performance
Responsible to lead and perform root cause analysis and solve problems using analytical and technical skills to optimize data delivery and reduce costs
Engages business end users and shares responsibility leading a delivery team.
Responsible to mentor Data Engineers at all levels of experience
