Data Engineer

Data Engineering (AWS + Snowflake)

Location: Chennai

Position Overview

We are seeking an experienced Associate Director of Data Engineering to lead our AWS and Snowflake-based data platform initiatives. This role combines deep technical expertise with strong delivery management capabilities, requiring a hands-on leader who can architect scalable solutions while managing cross-functional teams to successful implementation.

Key Responsibilities

Solutioning & Architecture:

• Design and architect end-to-end data engineering solutions leveraging AWS services (S3, Glue, EMR, Lambda, Kinesis, Redshift) and Snowflake
• Experience in implementing Data Vault is desired
• Define data lake and data warehouse architectures that support enterprise-scale analytics and business intelligence requirements
• Develop data integration strategies, ETL/ELT frameworks, and data pipelines using modern engineering practices
• Establish data governance frameworks, security protocols, and compliance standards across cloud platforms
• Evaluate emerging technologies and recommend innovative approaches to optimize data infrastructure

Delivery Management:

• Lead multiple concurrent data engineering projects from initiation through deployment and post-production support
• Manage project timelines, resources, budgets, and stakeholder expectations across complex implementations
• Coordinate with business stakeholders, data scientists, analysts, and engineering teams to ensure alignment with business objectives
• Implement Agile/Scrum methodologies and drive continuous improvement in delivery processes
• Manage risks, dependencies, and impediments to ensure on-time, high-quality deliverables

Team Leadership:

• Build, mentor, and develop a high-performing team of data engineers and technical specialists
• Provide technical guidance and code reviews to ensure best practices and quality standards
• Foster a culture of innovation, collaboration, and continuous learning within the team
• Conduct performance evaluations and support career development initiatives

Technical Delivery:

• Hands-on involvement in complex technical implementations including data modeling, pipeline development, and performance optimization
• Ensure scalability, reliability, and performance of data platforms supporting petabyte-scale data processing
• Implement DataOps practices including CI/CD pipelines, automated testing, and monitoring frameworks
• Troubleshoot production issues and implement preventive measures

Required Qualifications

• Bachelor's or masters degree in computer science, Engineering, or related technical field
• 15+ years of experience in data engineering with at least 3 years in leadership roles
• Strong expertise in AWS cloud services (S3, Glue, EMR, Lambda, Athena, Kinesis, Step Functions, Lake Formation)
• Extensive hands-on experience with Snowflake including architecture, optimization, and SnowSQL
• Proficiency in programming languages such as Python, SQL, and Scala/Java
• Experience with infrastructure-as-code tools (Terraform, CloudFormation)
• Proven track record of delivering large-scale data platform projects in enterprise environments
• Strong understanding of data warehousing concepts, dimensional modelling, and ETL/ELT patterns
• Experience with big data technologies (Spark, Hadoop, Kafka)
• Demonstrated ability to translate business requirements into technical solutions

Preferred Qualifications

• Domain experience Wealth Management/Capital Markets
• AWS certifications (Solutions Architect, Data Analytics, or similar)
• SnowPro certifications (Core or Advanced)
• Experience with data governance tools (Collibra, Alation, AWS Glue Data Catalog)
• Knowledge of streaming data architectures and real-time processing
• Familiarity with dbt (data build tool) and modern data stack components
• Experience with DataOps and MLOps practices
• Strong presentation and stakeholder management skills
• PMP, Scrum Master, or similar project management certifications