Role Summary
We are seeking an experienced Lead Data Engineer to design, build, and maintain scalable data pipelines utilizing the Microsoft Fabric ecosystem. This role focuses on implementing Medallion Architecture to ensure data governance and analytics readiness while collaborating with stakeholders to translate business requirements into robust data solutions.
Key Responsibilities
- Design, build, and maintain scalable data pipelines using Microsoft Fabric (Data Factory, Lakehouse, Warehouse).
- Implement Medallion Architecture (Bronze, Silver, Gold layers) to ensure data quality, governance, and analytics readiness.
- Ingest structured and semi-structured data from multiple sources using Fabric Data Factory pipelines.
- Perform data transformation, cleansing, and enrichment using Spark (PySpark) and SQL.
- Support data analysis and business intelligence by preparing datasets for Power BI dashboards and reports.
- Optimize performance and cost through partitioning, indexing, and query tuning.
- Collaborate with data analysts, data scientists, and business stakeholders to translate requirements into data solutions.
- Monitor pipeline execution, troubleshoot failures, and implement error-handling mechanisms.
- Stay current with Microsoft Fabric updates and best practices to continuously improve data solutions.
Required Skills
- Must-have skills:
- Microsoft Fabric (Data Factory, Lakehouse, Warehouse)
- Strong proficiency in Spark (PySpark) and SQL
- Experience implementing Medallion Architecture (Bronze, Silver, Gold layers)
- Data ingestion and transformation techniques
- Good-to-have skills:
- Experience preparing datasets for Power BI
- Performance tuning (partitioning, indexing)
- Error handling and pipeline monitoring
Qualifications
- Relevant technical background or degree in Computer Science, Data Engineering, or a related field (implied based on role level).
Additional Information
- Project Duration: 3-6 Months
- Start Date: Immediate (Feb 04, 2026)
- Job ID: 128e2ml7moete
#DataEngineering #MicrosoftFabric #RemoteJobs #ContractJobs #DataFactory #PySpark #SQL #PuneJobs #HiringNow #TechJobs
