Data Engineer

At CommBank, we never lose sight of the role we play in other people’s financial wellbeing. Our focus is to help people and businesses move forward to progress. To make the right financial decisions and achieve their dreams, targets, and aspirations. Regardless of where you work within our organisation, your initiative, talent, ideas, and energy all contribute to the impact that we can make with our work. Together we can achieve great things.

Job Title: Data Engineer

Location: Bangalore

Business & Team:

The Business Banking Technology Domain works in an Agile methodology with our business banking business to plan, prioritise and deliver on high value technology objectives with key results that meet our regulatory obligations and protect the community.

You will work within the VRM Crew that is working on initiatives such as Gen AI based cash flow coach to provide relevant data to our regulators

Impact & Contribution:

As a Data Engineer and database engineer you will be creating and managing the cloud databases and data pipelines that underpin our decoupled cloud architecture and API first approach. You have proven expertise in database design, data ingestion, transformation, data writing, scheduling and query management within a cloud environment.

You will have proven experience and expertise in working with AWS Cloud Infrastructure Engineers, Software/API Developers to design, develop, deploy and operate data services and solutions that underpin a cloud ecosystem. You will take ownership and accountability of functional and non-functional design and work within a team of Engineers to create innovative solutions that unlock value and modernise technology designs.

You will role model continuous improvement mindset in the team, and in your project interactions, by taking technical ownership of key assets, including roadmaps and technical direction of data services running on our AWS environments.  

Roles & Responsibilities:

• Can design and implement databases for data integration in the enterprise

• Can performance tune applications from a database code and design perspective

• Can automate data ingestion and transformation processes using scheduling tools.
  Monitor and troubleshoot data pipelines to ensure reliability and performance.

• Can design application logical database requirements and implement physical solutions

• Can collaborate with business and technical teams in order to design and build critical databases and data pipelines 

Essential Skills:

• Minimum 4 to 6 years of experience

• AWS Data products such as AWS Glue and AWS EMR

• Oracle and AWS Aurora RDS such as PostgreSQL

• AWS S3 ingestion, transformation and writing to databases

• Proficiency in programming languages like Python, Scala or Java for developing data ingestion and transformation scripts.

• Strong knowledge of SQL for writing, optimizing, and debugging queries.

• Familiarity with database design, indexing, and normalization principles.
  Understanding of data formats (JSON, CSV, XML) and techniques for converting between them. Ability to handle data validation, cleaning, and transformation.

• Proficiency in automation tools and scripting (e.g., bash scripting, cron jobs) for scheduling and monitoring data processes.

• Experience with version control systems (e.g., Git) for managing code and collaboration.

Education Qualifications:

• Bachelor’s degree in engineering in Computer Science/Information Technology.