Senior Data Engineer

Organization: At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Senior Data Engineer

Location: Bangalore - Manyata Tech Park

Business & Team: The Chief Data Analytics Office (CDAO) provides specialised data services and platforms for the CommBank group. It is accountable for developing the Group’s data strategy, policy, standards, governance, and requirements for data enablers/tools. The team also facilitates a community of practitioners to share best practices and build data talent and capabilities.

Impact & Contribution: The Data Practice within the Chief Data and Analytics Office (CDAO) is responsible for leading the strategic development of data products through frameworks, guiding principles, and reusable patterns. It drives data strategy, governance, and DevSecOps best practices across teams, while fostering data literacy, community engagement, and continuous improvement. The practice collaborates with cross-functional stakeholders to solve business problems using data, ensuring alignment with enterprise goals and regulatory standards.

Roles & responsibilities:

Accelerated data delivery-

• Understand business problems and devise data & analytics driven solutions
• Innovate to continuously identify opportunities to simplify, automate & improve data delivery speed
• Deliver proof of concepts/ technical spikes and leading examples of accelerated data delivery using new solution patterns/ capabilities
• Execute end-to-end data delivery iteratively through requirements, solutioning, data profiling, data design/ modelling, development, testing, release management and operate in production
• Develop strategic data products
• Ensure industry best practices of engineering and Data DevSecOps are followed

Data delivery practice-

• Provide data delivery guidance for evolving needs from federation, strategy and transformation
• Contribute to data delivery knowledge management outcomes via playbooks, learning materials & education sessions
• Contribute to data maturity outcomes and data literacy initiatives

Essential skills:

• Minimum experience is 8+ years of experience at Senior Data Engineer level in large Banks/ organizations
• Good understanding of data delivery life cycle & associated concepts including data analysis, data profiling, data design, data modelling, data ingestion, data cleansing, data extraction, data definitions/dictionary, data lineage mapping, data classification, data quality, etc.
• Sound Programming Skills in the programming languages like: PySpark, Python, Java, Scala (any one) with sound skills in writing SQL scripts using Spark SQL or any RDBMS (DBT - Data Build Tool is good to have)
• Experience in Big Data solutions using Cloudera Hadoop eco-systems, Teradata platform using Spark/TCF and various ETL frameworks
• Experience with AWS Cloud platform and Snowflake
• Awareness of data modelling concepts/ frameworks, design patterns (FSLDM, IBM IFW DW, BIAN) and techniques such as Data Vault, Kimball, 3NF
• Sound experience in building data pipelines & ETL tools - AWS Data Stack (Ab Initio is good to have)
• Experience in designing and developing ETL test scripts for structured and unstructured data
• Sound skills testing solutions with large data volumes and complex data transformation rules
• Sound Leadership and behavioural skills including Active Listening, Constructive Challenge, Problem Solving and Risk management
• Sound in AI and Data Literacy with an experience and ability to use AI Tools into development lifecycle

Education Qualification: Bachelor’s degree or Master’s degree in Engineering in Computer Science/Information Technology