Country: India
Position Location: Noida, Bangalore
Contract Type: Permanent
Work Pattern: Full Time
Sector: Digital Ventures
Discipline: Digital design
Job Ref: 2142
Recruiter Contact: Shael Bansal
Responsibilities
- Build data pipelines: Managed data pipelines consist of a series of stages through which data flows (for example, from data sources or endpoints of acquisition to integration to consumption for specific use cases). These data pipelines must be created, maintained and optimized as workloads move from development to production for specific use cases.
- Architecting, creating and maintaining data pipelines will be the primary responsibility of the data engineer.
- Drive Automation through effective metadata management:
- The data engineer will be responsible for using innovative and modern tools, techniques and architectures to partially or completely automate the most-common, repeatable and tedious data preparation and integration tasks in order to minimize manual and error-prone processes and improve productivity.
- The data engineer will also need to assist with renovating the data management infrastructure to drive automation in data integration and management.
This Will Include (but Not Be Limited To)
Learning and using modern data preparation, integration and AI-enabled metadata management tools and techniques.
Tracking data consumption patterns.
Performing intelligent sampling and caching.
Monitoring schema changes.
Recommending or sometimes even automating existing and future integration flows.
Candidate Specification
- Should have 7+years of experience and atleast 4 years of experience required in data enginereing domain.
- Demonstrated expertise and hands-on experience with Azuretechnologies like Azure Data Lake Storage, Azure Data Factory, Azure Logic Apps, Azure Synapse, Azure functuionsetc. is required.
- Strong understanding and hands-on experience with ELT and ETL postulates.
- Strong hands on experience with SQL, preferably in SQL Server, SSRS/SSAS/SSIS
- Hands on experience working with BI developers and data analysts to understand the reporting requirements and build out data models for reporting.
- Experience in batch and real-time data processing
- Demonstrated expertise and hands-on experience in building scalable and optimized data pipelines along with optimizing performance of database queries.
- Demonstrated expertise and hands-on experience working with complex and large data sets in a multi-sector environment
- Proficient in creating optimized stored procedures and other integration techniques within the database;
- Experience with the following tools: Microsoft SharePoint, Excel, Power BI, PowerPoint, Word.
- Proficiency in Azure DevOps is required;
We Can Offer (subject To Companys Policy)
- Agile and safe working environment
- Competitive annual leave and sick leaves
- Group incentive scheme
- Group term life insurance, Workmens compensation and Group medical insurance coverage
- Short and Long-term Global employment opportunities
- Global collaboration and knowledge sharing
- Digital Innovation and Transformation
Equality, diversity and inclusion
We put equality, diversity and inclusion at the heart of our business, seeking to promote fair employment procedures and practices to ensure equal opportunities for all. We encourage individual expression in our workplace and are committed to creating an inclusive environment where everyone feels they have the opportunity to contribute.
Agile working
At Mott MacDonald, we believe it makes business sense for you and your manager to choose how you can work most effectively to meet your client, team and personal commitments. We embrace agility, flexibility and trust.
