Data Engineer

JOB Description :

Role: Senior Data Engineer

Location: Chennai / Bengaluru

Work Mode : Hybrid

Notice Period: Immediate to 15 days

Years of Exp: 5+ Years

About the Role

:We are looking for a highly skilled Senior Data Engineer with ML to design, build, and operate reliable, scalable, and cost-efficient data pipelines. This role focuses on production-grade data systems using Python and modern orchestration tools, with strong collaboration across Data Science and analytics teams

.You will play a key role in enabling high-quality, well-governed, and discoverable data across the organization

.

Key Responsibilitie

Data Pipeline Engineering

• Design, build, and maintain robust, scalable data pipelines using Python
• Develop and manage orchestration workflows using Apache Airflow / Google Cloud Composer.
• Ensure high availability, fault tolerance, and performance of data workflows
• wsImplement monitoring, alerting, and observability best practices.

Production Operations & Reliability

• Own scheduling, monitoring, and incident management for data pipelines
• Ensure SLAs and data freshness requirements are met
• Implement proactive quality checks and validation frameworks
• Optimize pipelines for performance and cost-efficiency in cloud environments

Data Governance & Collaboration

• Define and enforce data contracts across producers and consume
• Contribute to and maintain a data catalog
• Partner closely with Data Science and Analytics teams for schema alignment, data discovery, and pipeline optimization
• Support reproducibility and transparency of datasets used in modeling

Cloud & Architecture

• Work within Google Cloud Platform (GCP) environments
• Design cost-aware architectures and storage strategies
• Improve CI/CD, version control, and deployment workflows for data systems

.Required Skills & Experience

• Strong proficiency in Python with ML Deployment (must)
• Hands-on experience with Apache Airflow and/or Google Cloud Composer
• Experience building and maintaining production data pipelines
• Strong understanding of

Workflow orchestration (Airflow)

Monitoring & alerting

Data quality frameworks

Scheduling & dependency management

• Experience with cloud platforms (preferably GCP)
• Solid understanding of data modeling and pipeline design principle
• Experience implementing or working with data contract
• Exposure to data catalogs and metadata management.
• Strong operational mindset with focus on reliability and maintainability