Senior Manager-Technology (Data Engineer)

Senior Manager-Technology (Data Engineer) Apply NowGrade K+ Jobnumber MGS01817 Closing date 06-Sep-2024 Job Purpose

Data & Analytics Driven Organization: One Data and Finance Reporting Function drive the vision to transform the Bank into a Data Driven Organization (DDO) using latest tools and technologies in Data space. RBG Data team is a stream within One Data Organization driving this agenda for Retail Banking function.

• Senior Data Engineer/Lead Data Engineer will design and maintain data pipelines of real-time and batch, creates data strategy, data architecture, best practices and who can lead the organization in making strategical improvements in the data engineering solutions.
• This role requires to have a knowledge of core system, retail banking systems, digital journeys, marketing systems, risk and compliance systems which are very data intensive systems across UAE, Egypt, Pakistan etc where bank operates retail business.
• Our core function spans multiple platforms like Enterprise Data Lake, Azure Data Lake, Business Intelligence, Advanced Analytics and Realtime Streaming platforms.
• The work involves developing new requirements in both on-premises and cloud data lake's estimating the efforts, designing an effective solution, data architecture and management, change release management, resource management, handling the deliverables across the business groups in the Bank. Also, handling critical applications that influence bank's management decision making process, regulatory reporting (which can influence financial/non-financial penalties) and operational reporting.
  
  

Key Result Areas

• Develops and maintains scalable data pipelines of batch and real-time to support continuing increases in data demands of volume and complexity.
• Set the best practices and quality on the deliveries.
• Designs and Develops Data domains across banking products and laying foundation for Data Mesh architecture.
• Demonstrate deep knowledge and experience in databases, Datamart's, Data Modelling, Data Governance, Data Security, BI tools, ETL Solutions.
• Data Orchestration and Data-Ops practices enabler for the team
• Collaborates with analyst, data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Writes unit/integration tests, contributes to engineering wiki, and documents work.
• Experience in Automating Deployment, scheduling, monitoring, and management of datasets and pipelines
• Understand business requirements and identify key performance indicators (KPIs) in Data Engineering.
• Design data models to transform raw data into meaningful insights.
  
  

Key Result Areas (Continued)

• Develops and maintains scalable data pipelines of batch and real-time to support continuing increases in data demands of volume and complexity.
• Set the best practices and quality on the deliveries.
• Designs and Develops Data domains across banking products and laying foundation for Data Mesh architecture.
• Demonstrate deep knowledge and experience in databases, Datamart's, Data Modelling, Data Governance, Data Security, BI tools, ETL Solutions.
• Data Orchestration and Data-Ops practices enabler for the team
• Collaborates with analyst, data scientists and business teams to improve data models that feed business intelligence tools, increasing data accessibility, and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Writes unit/integration tests, contributes to engineering wiki, and documents work.
• Experience in Automating Deployment, scheduling, monitoring, and management of datasets and pipelines
• Understand business requirements and identify key performance indicators (KPIs) in Data Engineering.
• Design data models to transform raw data into meaningful insights.
  
  

Key Result Areas (Continued)

• Identify, analyze various risks, and implement risk management controls, RCSA and contingency plans on Data Platform to mitigate future risk.
• Reviewing, executing, and documenting Audit activities and its corrective actions on Data Platform.
• Ensuring Data Platform security and compliance with data privacy regulations and company policies. Implementing access controls, data masking, and encryption where necessary to safeguard sensitive information.
• Understands industry trends and the practical application of existing, new, and emerging technologies.
• Forecasting future data storage and processing requirements and planning for scalability. Identifying potential bottlenecks and devising strategies to accommodate growing data volumes.
• Developing and maintaining disaster recovery plans and business continuity strategies to address potential risks and minimize downtime.
• Communicate and effectively articulate the DWH/DL solution/roadmaps to business and technical delivery teams.
• Coordinate with change management approval board to get all desired approvals and ensure production deployments on timely manner.
• Collaborate with Incident management team to track and report on incidents, their resolutions, and any necessary follow-up actions.
• Interacting with Data Platform software and hardware vendors to coordinate support, updates, and service-level agreements.
  
  

Knowledge, Skills and ExperienceCore Skills:

• Data engineer with a solid technical background and experience in data-intensive systems ( 7 years)
• Strong experience in Big Data, Hadoop Ecosystem, Spark Streaming, Kafka, Python, SQL, Hive, NIFI, Airflow
• Proficient with Azure Cloud services such as Azure Data Factory (ADF), Databricks, ADLS, Azure Synapse, Logic Apps, Azure Functions. Or similar data stack knowledge within Google/AWS cloud services
• Proficiency in relational SQL, Graph and NoSQL databases.
• Proficiency in Elastic Search and Couchbase databases
• In-depth skills in developing and maintaining ETL/ELT data pipelines.
• Experience in data modelling techniques such as Kimball star schema, 3NF, vault modelling etc.
• Experience in workflow management tools such as Airflow, Oozie and CI/CD tools
• Data streaming solution in Kafka or Confluent Kafka
• Hands on experience in Google Big Query, Google Analytics & Clickstream Data Model
• Reporting knowledge in Power BI, Tableau, Qlik etc.
• Sound in Data Management Fundamentals and Data Architect, Modelling, Governance
• Strong Domain Knowledge in Banking/Finance area like understanding of the various processes, products, and services within the banking industry, core functions, regulations, and operational aspects of banking institutions.
• Hands on knowledge in Hadoop and Azure/AWS cloud ecosystem and ETL jobs migration
• Knowledge of Advance Analytics and AI tools
  
  

Knowledge, Skills and Experience (Continued)Management Skills:

• Follow predefined processes and workflows to carry out specific tasks and activities accurately and in a timely manner.
• Identify opportunities for process improvement and efficiency enhancement and provide feedback or suggestions to optimize workflows.
• Analyze the needs, expectations, and concerns of each stakeholder. Assess their level of influence, interest, and potential power to affect the project's success.
• Developing a comprehensive project plan that outlines the project scope, objectives, deliverables, timelines, resource requirements, and budget.
  
  

Additional Skills Desired:

• Bachelors/Master's degree in computer science or equivalent
• Excellent verbal and written communication skills and good stake holder management skills
• Strong Analytical thinking and ability to handle stakeholders.
• Confident in decision making and the ability to explain processes or choices as needed.
• Ability to multitask on multiple projects in various phases.
• Agile and waterfall Project Methodology Knowledge
• Program Management & Deliverable