We are seeking a skilled and motivated Data Engineer with a minimum of 2 years of experience in the field. The ideal candidate should have a strong background in data engineering, with expertise in technologies such as Databricks, Azure, Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), Azure Synapse Analytics, and SQL.
Responsibilities:
- Design, develop, and implement end-to-end data pipelines using Databricks, Azure Data Factory, and other relevant technologies.
- Build and optimize data models for performance and efficiency.
- Work with large datasets and ensure data quality and integrity.
- Troubleshoot and optimize existing data pipelines for performance and reliability.
Required Skills and Qualifications:
- Minimum of 2 years of hands-on experience as a Data Engineer.
- Strong proficiency in Databricks, Azure, Azure Data Factory, Azure Data Lake Storage, Azure Synapse Analytics, and SQL.
- Experience with data modeling, ETL processes, and data warehousing concepts.
Preferred Qualifications:
- Certification in relevant technologies (e.g., Azure Data Engineer, Databricks Certified Associate).
- Familiarity with other cloud platforms (e.g., AWS, GCP).
- Experience with big data technologies such as Apache Spark.
- Knowledge of scripting languages such as Python or PowerShell