Staff Data Engineer

Organization:

At CommBank, we're building tomorrow’s bank today, which means we need creative and diverse engineers to help us redefine what customers expect from a bank. Envisioning new technologies that are waiting to be invented and reimagining products that support our customers and help build Australia’s future economy.
 

Job Title: Staff Data Engineer

Location: Bangalore

Business & Team: Corp Tech
 

Impact & Contribution:

• Passionate about building next generation data platforms and data pipeline solution across the bank.
• Enthusiastic, be able to contribute and learn from wider engineering talent in the team.
• Ready to execute state-of-the-art coding practices, driving high quality outcomes to solve core business objectives and minimise risks.
• Capable to create both technology blueprints and engineering roadmaps, for a multi- year data transformational journey.
• Can lead and drive a culture where quality, excellence and openness are championed.
• Constantly thinking outside the box and breaking boundaries to solve complex data problems
   

Roles & Responsibilities:

• Contribute to full development life cycle, including requirement analysis, functional design, technical design, programming, testing, documentation, implementation and ongoing technical support for agile projects.
• Contribute to projects/CR's utilizing Ab-Initio (ETL), Oracle and cloud technologies.
• Understand our customers' core business objectives and build end-to-end data centric solutions to address them.
• Lead or participate in the definition, execution and communication of ETL strategy and technical solution.
• Develop complex data transformations, data cleansing and data aggregation logic using Ab-Initio tools.
• Ensure high quality code by performing thorough testing, code reviews and debugging of Ab-Initio graphs and components.
• Cooperate with business and operational users, other data management staff and infrastructure teams to ensure adherence to client and company guidelines, restrictions and requirements as well as industry standards.
• Improve team development related processes that accelerate delivery, drive innovation, lower cost and improve quality.
• Adhere to the Code of Conduct. The Code of Conduct sets the standards of behaviour, actions and decisions we expect from our people.

Essential Skills:
 

We use a broad range of tools, languages, and frameworks. We don’t expect you to know them all but experience or exposure to some of these (or equivalents) will set you up for success in this team.

• Experience in designing, building, and delivering enterprise-wide data ingestion, data integration and data pipeline solutions using Big Data and Data Warehouse platform.  Preferably with at least 15+ years of hands-on experience in a Data Engineering role.
• Extensive experience in ETL Ab-initio tools like GDE, Express-IT, Control centre, Mhub, Conduct-IT and Meta programming 
• Graphical Development Environment (GDE): Advanced proficiency in designing and optimizing graphs.
• Co>Operating System: Deep understanding of the runtime environment and its configuration.
• Data Manipulation and Transformation: Expertise in using components like Join, Sort, Rollup, Scan, Aggregate, Normalize, etc.
• Continuous Flows (Continuous Graphs): Experience with real-time data processing.
• Express>It and Metadata Hub: Familiarity with metadata-driven development.
  Conduct>It: Workflow orchestration and job scheduling.
• Ab Initio Query>It: For querying metadata and lineage. 
• Performance Optimization: Tuning Ab Initio graphs and system resources.
• Root Cause Analysis: Debugging complex data issues across systems.
• Data Quality Frameworks: Implementing validation, cleansing, and reconciliation logic.
• Experience in building data solutions using AWS Cloud technology (EMR, Glue, Iceberg, Kinesis, MSK/Kafka, Redshift, Document DB, S3, etc.).  Preferably with 3+ years of hands-on experience and certified AWS Data Engineer.
• Strong Unix/Linux Shell scripting and programming skills
• Proficient in SQL scripting, writing complex SQLs for building data pipelines.
• Experience in leading and mentoring data engineers, including ownership of internal business stakeholder relationships and working with consultants.
• Experience in working in Agile teams, including working closely with internal business stakeholders.
• Experience in development, production support and troubleshooting issues.
• Experience in process optimization - SQL, ETL etc
• Experience in Big data platform for ETL development with AWS cloud platform.
• Should have experience with Oracle SQL database programming, SQL performance tuning, and relational model analysis.
• Good automation skills in areas such as data ingestion, APIs, file transfers.
• Knowledge and experience with Dev SecOps practices and tools

Education Qualification:

• Bachelor’s degree in computer science, Computer Engineering, Electrical Engineering (or similar)