Organization
At CommBank, we never lose sight of the role we play in other people s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.t
Job Title: Software Engineer - ETL/ BigData/ Automation
Location: Bangalore
Business & Team: PSU IT
Impact & contribution
- Collaborate with Business Banking stakeholders to develop & store payments data on cloud and help the squads in building the targeted applications-based cloud based microservices.
- Bringing the best design and development solutions to some of the complex problems in the data services crew and doing POC with latest tech stack and helping the squads to build the solutions with latest tech stack.
Reporting Lines:
The role position reports into the India Chapter Lead - in the data services crew.
Key relationships:
- Crew Tech Leads & Crew Leads
- Product Owners
- Agility Chapter Members
- Squad Members
- Performance Leads
- Chapter Area Leads
- Solution Architects.
Roles & Responsibilities:
- Have sound knowledge building data pipelines using big data tech stacks.
- Deploy, support and monitor new and existing services, platforms, and Oracle application, DB ELT data load, Big Data, Data Analysis
- Build and manage systems, infrastructure and applications through automation
- Provide performance tuning/recommendations for mission-critical platforms and infrastructure Identify, troubleshoot, and resolve issues in live production environments
- Creation and keeping up to date of efficient production run-books and SOPs
- Big data application development in Unix, Linux platform
- Hands-on experience in Spark, Scala, Hive, HDFS, Sqoop, Kafka, DevOps.
- Shell scripting and SQL database queries
Essential Skills
- To succeed in this role, you need a strong background in software engineering and a good understanding of ETL, Big data, Automation, Linux system, Snowflake and AWS.
- Data Engineer - 4-6 years.
- Experience in building data solution in Hadoop platform, using Spark, MapReduce, Kafka and various ETL frameworks for distributed data storage and processing. Preferably hands-on experience
- Strong Unix/Linux Shell scripting and programming skills in Java, Scala or Python.
- Experience in working in Agile teams, including working closely with internal business stakeholders.
Education Qualifications:
- Bachelor s degree/master s degree in engineering in Computer Science/Information Technology or any similar stream
Advertising End Date: 26/09/2024
