Login Sign Up

Lead Data Engineer

PwC Acceleration Center India

5 - 10 years

Bengaluru

Posted: 13/06/2026

Job Description

Roles and Responsibilities:

  • Define the enterprise data engineering architecture and technology standards across DB2, SQL Server, IBM DataStage, IBM Workload Scheduler, Oracle GoldenGate, and AWS
  • Lead the multi-year platform modernization roadmap phased migration from legacy on-premises patterns to cloud-native AWS data engineering patterns
  • Govern platform health including capacity planning, performance benchmarks, upgrade management, and disaster recovery compliance with BCP/DR standards
  • Lead workload rationalization identifying pipelines, stored procedures, and jobs for consolidation, retirement, or re-architecture
  • Evaluate and drive adoption of modern data engineering capabilities (Apache Airflow, dbt, AWS Glue, Spark) aligned to Project Catalyst objectives
  • Own SLA adherence across all data engineering queues incidents, service requests, small-ticket enhancements, and larger backlog-driven work
  • Lead root cause analysis (RCA) for critical data incidents and drive permanent fixes to prevent recurrence
  • Lead monthly release cycles including environment coordination, change control governance, and production readiness sign-off
  • Maintain full backlog visibility in ServiceNow classification, aging, capacity tracking, and executive-level reporting
  • Define and oversee data quality monitoring frameworks, escalation procedures, and continuous improvement programs
  • Serve as the primary data engineering relationship owner for senior stakeholders across PHP, PDS/PMG, Quality, and System Services
  • Own CSAT measurement and improvement for the data engineering domain, proactively addressing data trust and availability concerns
  • Deliver weekly operational and monthly executive reporting on pipeline health, throughput, SLA performance, and platform KPIs
  • Develop and own the multi-year data engineering roadmap aligned to Project Catalyst's stabilization-to-modernization progression
  • Lead the phased AWS cloud migration strategy for remaining on-premises data engineering components, ensuring continuity and minimal disruption
  • Identify and implement automation opportunities to reduce manual pipeline interventions, dataset refreshes, and extract requests
  • Lead knowledge management across the engineering team runbooks, architecture diagrams, onboarding playbooks, and continuity documentation

Required Qualifications

  • Minimum Degree Required: Bachelors Degree in Engineering, Statistics, Mathematics, Computer Science, Data Science, Economics, or a related quantitative field
  • 8+ years of data engineering experience with deep expertise in enterprise ETL/ELT architecture, pipeline design, and large-scale data platform operations
  • 3+ years in a formal lead, manager, or technical lead capacity overseeing a data engineering team
  • Expert-level SQL proficiency in IBM DB2 and SQL Server including complex schema design, query optimization, and stored procedure management
  • Expert-level IBM DataStage experience including architecture, parallel job design, performance tuning, and enterprise deployment
  • Deep expertise in IBM Workload Scheduler complex job stream design, dependency management, SLA configuration, and production operations
  • Advanced Oracle GoldenGate experience including replication architecture, CDC design, and production support
  • Proven AWS data engineering experience in production S3, Glue, RDS, Redshift, Lambda, and IAM-governed data access
  • Demonstrated ability to develop and execute multi-year technology roadmaps and lead platform modernization programs
  • Experience leading managed services or outsourced delivery models with SLA, CSAT, and throughput accountability

Preferred Qualifications

  • Healthcare data engineering experience across claims, clinical (HL7/FHIR), EMR, pharmacy, population health, or regulatory reporting domains
  • AWS certification Data Engineer Professional, Solutions Architect Professional, or equivalent
  • Experience with modern data stack adoption in enterprise settings Apache Airflow, dbt, Spark, Delta Lake, or equivalent
  • Knowledge of HIPAA, HITRUST, CMS, and healthcare data regulatory compliance requirements
  • Experience leading on-premises to cloud migrations for large-scale enterprise data platforms
  • Familiarity with Tableau, BusinessObjects, or SAS as downstream analytics consumers of engineered data
  • Background in agile delivery, DevOps practices, and CI/CD pipelines for data engineering

Services you might be interested in

We Search & Apply Jobs for You!

Our team scans through 1000s of opportunities and applies to roles best suited to your profile

Save 100+ hours and focus on what matters - cracking interviews and landing offers.