Lead Data Engineer

Role : Lead GCP Data Engineer

Location - Hyderabad(Hybrid)

Exp - 10+ Years

Employment Type : Permanent

Notice Period: Immediate Joiners Only

Job Description :

Design, develop, test, and maintain scalable ETL data pipelines using Python.

Work extensively on Google Cloud Platform (GCP) services such as:

Dataflow for real-time and batch data processing

Cloud Functions for lightweight serverless compute

BigQuery for data warehousing and analytics

Cloud Composer for orchestration of data workflows (based on Apache

Airflow)

Google Cloud Storage (GCS) for managing data at scale

IAM for access control and security

Cloud Run for containerized application

Required Skills:

10+ years of hands-on experience in Python for backend or data engineering

projects.

Strong understanding and working experience with GCP cloud services

(especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).

Solid understanding of data pipeline architecture, data integration, and

transformation techniques.

Experience in working with version control systems like GitHub and knowledge of

CI/CD practices.

Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs.

Strong experience in SQL with at least one enterprise database (SQL Server,

Experience in data migrations from on-premise data sources to Cloud platforms.

Important Note (Please Read Before Applying)