Overview:
As an Azure Data Engineer at our company, you will play a crucial role in designing, implementing, and maintaining the data processing systems on the Microsoft Azure platform. You will work closely with stakeholders to understand their data needs and then develop scalable data pipelines and solutions to support the organization's analytical and operational requirements.
Key Responsibilities:
Azure DE (10 Positions)
- Experience in Developing Data Pipelines that process large volumes of data using Python, PySpark, Pandas etc, on Azure.
- Experience in developing ETL, OLAP based and Analytical Applications.
- Experience in ingesting batch and streaming data from various data sources.
- Strong Experience in writing complex SQL using any RDBMS (Oracle, PostgreSQL, SQL Server etc.)
- Ability to quickly learn and develop expertise in existing highly complex applications and architectures.
- Azure Data Bricks (ADB), Azure Synapse Analytics, Azure Active Directory, Azure Storage, Azure Data Lake. Services (ADLS), Azure key vault, Azure SQL DB, Azure HDInsight.
- Experience of DevOps and CD/CD tools.
- Familiarity with Rest APIs.
- Clear and precise communication skills.
- Experience with CI/CD pipelines, branching strategies, & GIT for code management.
- Comfortable working in Agile projects.
