JOB DESCRIPTION
Data Engineer
Key Responsibilities:
- Proven experience in Data Engineer using Lakehouse/Medallion architecture.
- Design and develop scalable data processing systems using technologies such as Azure Databricks and Snowflake.
- Build and maintain data pipelines to ingest, transform, and distribute data from various sources into the data Lakehouse.
- Perform data profiling and analysis to identify data quality issues and provide recommendations for improvement.
- Collaborate with BA/DA and Business users to understand the requirements.
- Optimize data infrastructure for performance and efficiency.
- Identify opportunities for optimization and automation and implement them to streamline data processes.
- Collaborate with cross-functional teams to implement data-related solutions and achieve business objectives.
Requirements:
- 4+ years of experience in Data Engineering.
- Expertise in Azure Databricks and Azure cloud platform
- Good to have programming skills in Python.
- Proficiency in SQL and working with relational databases.
- Experience in working Snowflake database.
- Good to have Experience with Data modeling and schema design.
- Knowledge of distributed computing frameworks and data warehousing concepts.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
Technical Stack:
Data bricks, Snowflake, Data Warehouse concepts, ETL
QUALIFICATIONS
Data Engineer
Key Responsibilities:
- Proven experience in Data Engineer using Lakehouse/Medallion architecture.
- Design and develop scalable data processing systems using technologies such as Azure Databricks and Snowflake.
- Build and maintain data pipelines to ingest, transform, and distribute data from various sources into the data Lakehouse.
- Perform data profiling and analysis to identify data quality issues and provide recommendations for improvement.
- Collaborate with BA/DA and Business users to understand the requirements.
- Optimize data infrastructure for performance and efficiency.
- Identify opportunities for optimization and automation and implement them to streamline data processes.
- Collaborate with cross-functional teams to implement data-related solutions and achieve business objectives.
Requirements:
- 4+ years of experience in Data Engineering.
- Expertise in Azure Databricks and Azure cloud platform
- Good to have programming skills in Python.
- Proficiency in SQL and working with relational databases.
- Experience in working Snowflake database.
- Good to have Experience with Data modeling and schema design.
- Knowledge of distributed computing frameworks and data warehousing concepts.
- Strong problem-solving and troubleshooting skills.
- Excellent communication and collaboration skills.
Technical Stack:
Data bricks, Snowflake, Data Warehouse concepts, ETL
