Responsibilities:
- Data Pipeline Development:Design and implement ETL processes using Azure Data Factory to extract, transform, and load data from various sources into data warehouses.
- Data Analysis:Utilize SQL to query and analyze large datasets, ensuring data quality and integrity while delivering actionable insights.
- Databricks Management:Develop and optimize data workflows in Azure Databricks, leveraging Spark for data processing and analysis.
- Reporting and Visualization:Create interactive dashboards and reports using Power BI to present findings and support data-driven decision-making.
- Collaboration:Work closely with cross-functional teams, including data scientists and business stakeholders, to understand data needs and provide solutions.
- Documentation:Maintain clear documentation of data processes, architecture, and workflows to ensure knowledge sharing within the team.
Qualifications:
- 4 to 8 years of experience in data engineering, data analysis, or a related field.
- Proficiency in Azure Data Factory (ADF) for building and orchestrating ETL pipelines.
- Strong experience with Azure Databricks and Apache Spark for data processing.
- Solid SQL skills for querying and managing relational databases.
- Experience with Power BI for data visualization and reporting.
- Familiarity with data warehousing concepts and methodologies.
- Strong problem-solving skills and the ability to work independently and collaboratively.
- Excellent communication skills to convey technical concepts to non-technical stakeholders.
Preferred Qualifications:
- Experience with additional Azure services (e.g., Azure Synapse, Azure SQL Database).
- Knowledge of data governance and best practices in data management.
- Familiarity with programming languages such as Python or R.
Benefits:
- Competitive salary and performance-based bonuses.
- Health, dental, and vision insurance.
- Flexible work hours and remote work options.
- Opportunities for professional development and certifications.
