Senior Data Engineer, MNC 8 -12 yrs experience with Data Modelling, ADF, Data Warehousing, MySQL, Spring Boot skills for Bangalore location can share resume [Confidential Information] 9150728112
Job Description :
Responsibilities
- Lead the design and development of scalable and robust data warehouse solutions to support business intelligence and analytics initiatives.
- Collaborate with stakeholders to understand data requirements and translate them into technical specifications and design documents, utilizing Azure data services effectively.
- Manage the end-to-end ETL process, including data extraction, transformation, and loading from various source into the Azure data warehouse, employing Azure Data Factory, Azure Data Bricks, or similar tools.
- Define and implement data governance policies and procedures, standards, capabilities, and tools to ensure the accuracy, consistency, and reliability of master data across the organization.
- Develop and maintain data models, data mappings, and data integration workflows. Implement data quality rules and ensure data accuracy and consistency.
- Collaborate with cross-functional teams to ensure data governance and compliance with regulatory requirements.
- Provide guidance and support to business users on MDM best practices.
- Evaluate and select appropriate tools and technologies for data warehouse and master data management, ensuring alignment with business objectives and technical requirements.
- Conduct performance tuning and optimization of data warehouse queries and processes to enhance system performance and efficiency.
- Monitor and troubleshoot data warehouse and master data management systems, ensuring uptime, reliability, and data integrity.
- Provide technical leadership and mentorship to a team of data engineers and developers, fostering a culture of innovation, collaboration, and continuous learning.
- Stay current with industry trends and best practices in data warehouse and master data management and recommend innovations and improvements to enhance our data capabilities.
Required Technical and Professional Experience:
- 10+ years of overall experience with 7-8+ years of demonstrated experience in data warehouse design, development, and implementation.
- Bachelors degree in computer science, Information Systems, or related field; advanced degree preferred.
- Proficiency in data modelling, ETL development, and data integration techniques.
- Strong understanding of master data management concepts, principles, and best practices.
- Experience with data governance frameworks and tools for managing master data quality and consistency.
- Hands-on experience with data warehouse platforms
- Proficiency in SQL and scripting languages such as Python or Shell scripting.
- Experience in integrating business applications with MDM using Batch processes, Message Queues.
- Excellent communication skills with the ability to interact effectively with technical and non-technical stakeholders.
- Strong problem-solving and analytical skills, with a keen attention to detail.
- Proven leadership abilities with the ability to motivate and mentor a team of technical professionals.
- Experience working with business stakeholders and technology teams to manage master data effectively.
- Excellent verbal communication skills.
- Strong Experience of Spring Boot and MySQL is mandatory.
- Experience in Spring frame work and configure a MySQL database in Spring Boot,
Should have experience in JPA and how does Spring Boot support it and some common annotations used in Spring Data JPA and also some strategies to handle transactions in Spring Boot.
- Should have experience in implement exception handling in Spring Boot.
- Experience with integration using Java is a plus.
- Proficiency in designing RESTful APIs using Spring Boot and MVC architecture.
- Familiarity with JWT and OAuth2 is required.
- Expertise in Spring Boot with a focus on code optimization and memory management.
- Ability to write unit tests, integration tests, and perform performance testing.
- Experience with CI/CD pipelines using Jenkins is a bonus.
Preferred Qualifications
- Experience with cloud-based data warehouse solutions.
- Certification in data management or related field.
- Familiarity with data visualization tools such as Power BI, or Looker or Qlik.
- Exposure to messaging software / Data streaming platforms.
- Knowledge of agile development methodologies and DevOps practice.
