Job Title: Azure Data Engineer
Experience
: 5+ years: Full-time
Interview Mode: Virtual
- Notice Period: Immediate to 30 days
Company
: Purple Drive Technology
:
Purple Drive Technology is looking for a highly skilled
Azure Data Engineer with expertise in
PySpark and
SQL to join our team in Bangalore. The candidate will be responsible for developing and optimizing large-scale data solutions using Azure cloud technologies, including data ingestion, transformation, and storage. The role requires a deep understanding of cloud-based data engineering practices, data pipelines, and performance tuning.
Develop and manage
data pipelines using
PySpark and
SQL on Azure cloud.
- Design, build, and maintain large-scale data processing systems and data lakes on Azure.
Integrate and transform data from multiple sources into structured formats.ETL pipelines
for performance and scalability. Work with stakeholders to understand data requirements and design solutions accordingly.
- Manage data workflows using Azure Data Factory (ADF) and Azure Databricks.
Ensure data security, accuracy, and compliance with best practices.- Collaborate with data analysts, architects, and other engineers to deliver end-to-end data solutions.
Perform troubleshooting, debugging, and tuning for performance optimization.
- Document technical processes and best practices.
5+ years of experience as a Data Engineer with expertise in
Azure cloud platforms.
- Proficiency in PySpark for large-scale data processing.
Strong skills in SQL
and database management
(e.g., SQL Server, Azure SQL Database).Azure Data Lake
, Azure Data Factory
, and Azure Databricks
. Expertise in building and optimizing
ETL/ELT processes in cloud environments.
- Familiarity with Azure Synapse Analytics, Azure Blob Storage, and other Azure services.
Solid understanding of data warehousing
and data modeling
concepts.performance tuning
and troubleshooting complex data solutions. Good understanding of
version control systems (e.g., Git) and
CI/CD pipelines.
- Strong analytical skills and the ability to work independently or in a team.
Experience with
big data tools and frameworks (e.g., Hadoop, Spark).
- Knowledge of machine learning or AI frameworks is a plus.
Experience with Python
for scripting and automation.
:
Competitive and in line with industry standards.
Job Types: Full-time, Permanent
Pay: 420,- 86 - 1,209,014.32 per year
Experience: - total work: 5 years (Required)
PL/SQL: 1 year (Required)
- pysark: 4 years (Required)
Work Location: On the road
