Role Overview
We are looking for a skilled Azure Databricks Data Engineer with 3-4 years of experience to join our data engineering team. The ideal candidate will be proficient in building and optimizing data pipelines, leveraging Azure Databricks, and collaborating with cross-functional teams to drive data-driven insights.
Job Responsibilities
- Develop, implement, and maintain robust data pipelines using Azure Databricks.
- Collaborate with data scientists and analysts to gather requirements and ensure data integrity.
- Optimize ETL processes for efficiency and performance, utilizing best practices in data engineering.
- Monitor and troubleshoot data workflows to ensure data accuracy and availability.
- Implement data governance and quality measures across data sets.
- Create documentation for data processes, architecture, and workflows.
- Stay informed on industry trends and emerging technologies in data engineering.
