POSITION TITLE: Senior Data Brick Engineer
LOCATION: Sector 44, Gurugram, India
Position Overview: We are seeking a highly skilled and experienced Senior Databricks Engineer to join our dynamic data engineering team. The ideal candidate will have a strong background in Databricks, Azure, and SaaS products. This role involves designing, implementing, and optimizing data solutions using Databricks on Azure to support our data-driven initiatives.
Key Responsibilities
- Design and Development:
- Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure.
- Implement ETL processes to ingest and transform data from various sources into our data platform.
- Develop scalable and efficient data models to support analytics and reporting needs.
- Azure Integration:
- Integrate Databricks with Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse Analytics, and Azure Machine Learning.
- Utilize Azure DevOps for continuous integration and continuous deployment (CI/CD) of data solutions.
- SaaS Product Exposure:
- Collaborate with product teams to understand data requirements and integrate SaaS product data into the data platform.
- Develop data solutions that support SaaS product analytics and reporting.
- Performance Optimization:
- Monitor and optimize the performance of data pipelines and queries.
- Implement best practices for data governance, security, and compliance.
- Collaboration and Leadership:
- Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
- Mentor and guide junior engineers, promoting best practices and knowledge sharing within the team.
- Documentation and Reporting:
- Maintain comprehensive documentation of data engineering processes, designs, and solutions.
- Generate reports and dashboards to provide insights into data platform performance and usage.
Qualifications
Education:
- Bachelors or Masters degree in Computer Science, Engineering, or a related field.
- Experience:
- Minimum of 8-10 years of experience in data engineering or related roles.
- Extensive experience with Databricks and Azure.
- Proven experience with SaaS products and integrating their data into data platforms.
- Technical Skills:
- Proficiency in Spark, SQL, Python, and Scala.
- Strong understanding of Azure services and architecture.
- Experience with data warehousing, ETL/ELT processes, and data modeling.
- Knowledge of CI/CD practices and tools, particularly Azure DevOps.
- Soft Skills:
- Excellent problem-solving and analytical skills.
- Strong communication and collaboration abilities.
- Ability to work independently and lead projects.
Preferred Qualifications
- Certifications in Databricks, AWS, Azure, or related Cloud technologies.
- Experience with machine learning and AI integration.
- Familiarity with data visualization tools like Power BI or Tableau.
Benefits
- Competitive salary and performance-based bonuses.
- Comprehensive health insurance including Parents
- Complementary Buffet Meal Everyday
- Professional development opportunities and continuous learning.
Join our team and contribute to the development of high-quality business applications.
