Senior Data Engineer

Job Title: Senior Data Engineer GCP

Location; Chennai

Experience: 5- 10 Years

Role Overview

We are seeking a highly skilled Senior Data Engineer GCP to design, develop, and optimize scalable data solutions on Google Cloud Platform. The ideal candidate will have strong hands-on expertise in BigQuery, PySpark, and GCP data services, with experience building robust ETL frameworks and modern data platforms.

Key Responsibilities

• Design and develop robust, scalable, reusable, and efficient ETL pipelines on GCP.
• Implement and manage end-to-end GCP ETL frameworks.
• Build and optimize Data Lake and Data Warehouse solutions.
• Develop and manage complex transformations using BigQuery SQL and PySpark/Python.
• Work extensively with GCP services including Dataproc, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, Kubernetes, and Cloud Fusion.
• Optimize BigQuery architecture, manage datasets, and ensure performance tuning across workloads.
• Collaborate with cross-functional teams to understand business requirements and deliver data-driven solutions.
• Follow CI/CD best practices using Jenkins and Git repositories.
• Ensure data quality, governance, and best engineering practices across projects.

Required Skills

• Strong expertise in GCP data ecosystem and ETL framework development
• Hands-on experience with BigQuery (architecture, data types, optimization)
• Strong programming skills in Python and PySpark
• Experience with Dataproc, Dataflow, Cloud Composer, Pub/Sub, Cloud Functions, Kubernetes
• Good understanding of Data Lake and Data Warehouse concepts
• Experience with Jenkins and Git-based workflows

Good to Have

• DBT tool expertise and data solutioning experience
• Banking domain knowledge
• GCP Certification
• Strong communication skills and proactive team collaboration