Sr. GCP Data Engineer

We are looking for a Senior GCP Data Engineer with strong expertise in building scalable batch and real-time streaming data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience designing modern data platforms, processing large-scale datasets, and enabling analytics and machine learning use cases.

Key Responsibilities

• Design, build, and maintain scalable batch and real-time streaming data pipelines on GCP.
• Develop robust data processing workflows using Apache Beam with Google Cloud Dataflow.
• Build and manage real-time streaming pipelines using Apache Kafka, Google Cloud Pub/Sub, and Apache Spark.
• Implement high-performance batch data pipelines using Google Cloud Dataproc and Apache Airflow (or Cloud Composer).
• Design and optimize data warehouses using Google BigQuery for analytical workloads.
• Build data ingestion frameworks from multiple sources (APIs, databases, streaming sources, event systems).
• Ensure data quality, governance, monitoring, and observability of pipelines.
• Optimize performance, cost, and reliability of cloud data processing systems.
• Collaborate with Data Scientists, Analytics teams, and Product teams to enable data-driven solutions.
• Implement CI/CD pipelines and infrastructure automation for data engineering workflows.

Required Skills & Experience

28 years of experience in Data Engineering

• Strong programming skills in Python / Java / Scala.
• Hands-on experience with batch processing frameworks like Apache Spark.
• Experience with streaming data pipelines using Apache Kafka or Google Cloud Pub/Sub.
• Experience with workflow orchestration tools like Apache Airflow.
• Strong knowledge of SQL, data modeling, partitioning, and query optimization.
• Experience with data lake and data warehouse architectures.