- Provide technical and architectural leadership for a team managing enterprise data warehouse system
- Create Architecture and Design documentation for enterprise data warehouse system and present those to the review board
- Collaborating frequently with customer to provide solutions and assistance; and working with these customers to understand their requirements for implementations that add the most value to their business.
- Create functional design specifications, reference architectures, design documents and assist with other project deliverables as needed.
- Creating project and application architecture deliverables that are consistent with architecture principles, standards, methodologies, and best practices.
- Leading technical design sessions with the development teams and explaining detailed design specifications to ensuring that architecture standards are followed.
- Working under some supervision from a Solution Architect, but will be expected to work independently on complex, non-routine tasks and projects. You may interact with end users and other technical personnel to identify and correct issues.
- Maintain continuous, open, consistent professional communication with customers, peers and team members. Openly listen to others and confirm understanding to ensure everyone is on the same page.
- Communicating implications of architectural decisions, issues and plans to business and IT Leadership.
- Defining and validating non-functional (technical) requirements, and establishing traceability between requirements and application architecture/design.
- Providing support / guidance to the development teams during the analysis, development, and testing processes.
- Providing input to the development of project initiation documents including objectives, scope, approach, estimates, and deliverables, when needed.
Education qualification: BE /B Tech / MCA / MSc / M. Tech.
Experience:
- 12+ years of experience in data/big data technologies
- 4+ years of experience as an architect
Skills (Must have):
- Strong hands-on knowledge on SQL, Azure SQL, ADF, DataBricks, Azure Event hub, Spark, Hadoop, Azure Data lake Gen2, blob storage, Python, Azure Synapse Analytics.
- Strong knowledge of Azure AD, KeyVault, Azure Monitor
- Experience in architecting complex Enterprise grade solutions in cloud environments.
- Experience with integration of data from multiple data sources.
- Knowledge of various ETL techniques and frameworks.
- Experience of handling data encryption, data anonymization, data masking.
- Experience of data cataloguing, reference data management, data governance.
- Experience of handling data quality improvements using various processes, tools, transformations
- Experience of performance management and security management of data warehouse.
- Proficiency in data modelling and design, including SQL development and database administration.
- Ability to implement common data management and reporting technologies, as well as the basics of columnar and NoSQL databases, data visualization, unstructured data, and predictive analytics.
Skills (Good to have):
- Knowledge of Delta Lake, Delta tables, Delta live tables, Azure Cosmos database
- Knowledge of Azure functions, Microsoft Purview, Unity Catalog.
- Knowledge of Ataccama One.
- Knowledge of implementing Build and release pipelines for data warehouse solutions.