Organization: At CommBank, we never lose sight of the role we play in other people's financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.
Job Title: Senior Data Engineer
Location: Bangalore- Manyata Tech park
Business & Team:
The Chief Data and Analytics Office (CDAO) Data Platforms is in place to realise a data-driven organisation for Commonwealth Bank Group. We do this by solving complex problems around data for the business and activating data for strategic and sustained competitive advantage to enhance the financial wellbeing of our customers in a safe, sound and secure way.
As we embark on our cloud journey, the team is focussed towards building robust data processing frameworks for the bank, enabling secure and seamless data processing for our tenants in simplified and automated way.
Impact & Contribution:
As an experienced data engineer, you will work closely with other engineers from the crew and stakeholders to build robust data pipelines as we modernize our platform and frameworks for cloud. A passion for building data driven solutions catering to multiple stakeholders is imperative.
Bring your expertise in building scalable frameworks on cloud platform, with focus on automation and innovation.
Roles & Responsibilities:
- Possesses hands-on technical experience working in AWS. Individual should be well versed in working with AWS services like: S3, EMR, Athena, Amazon Managed Workflow for Apache Airflow (MWAA).
- Possesses hands-on technical experience working in Ab>Initio, preferably experienced in building data pipelines using PDL, meta-programming, Express>It and Conduct It.
- Well versed in Unix Shell scripting, Python scripting and PL/SQL.
- Passionate about Cloud/DevOps/Automation and possess a keen interest to solve complex problems in a systematic approach.
- Possess the ability work independently and propose designs/solutions along with collaborating closely with Technology Leads and Architects.
- Exhibit a proactive approach, constantly seeking innovative solutions to complex technical challenges.
- Offer mentorship to junior engineers, contributing effectively both as an individual and as a team member.
Essential Skills:
- Relevant experience of 8-10 years
- Experience with AWS services (S3, EMR, Athena, Glue)
- Experience with Ab>Initio product suite.
- Experience with CI/CD tools (Jenkins, GitHub etc)
- Experience in working with schedulers like : Apache Airflow
- Experience automating processes using Python, shell scripting, etc.
- Experience in writing and debugging complex PL/SQLs.
- Experience in working on Big Data Platforms (Hadoop/Hive)
- Experience in implementing large scale self-service enterprise data frameworks highly desirable.
- Exposure to open table format like Iceberg is desirable.
- Experience of working in Agile Methodology
Qualifications:
- Bachelor's degree/Master's degree in Engineering in Computer Science/Information Technology
If you're already part of the Commonwealth Bank Group (including Bankwest, x15ventures), you'll need to apply through Sidekick to submit a valid application. We're keen to support you with the next step in your career.
We're aware of some accessibility issues on this site, particularly for screen reader users. We want to make finding your dream job as easy as possible, so if you require additional support please contact HR Direct on 1800 989 696.
Advertising End Date: 27/11/2024
