GCP Lead

About Impetus

Impetus Technologies is a digital engineering company focused on delivering expert services and products to help enterprises achieve their transformation goals. We solve the analytics, AI, and cloud puzzle, enabling businesses to drive unmatched innovation and growth.

Founded in 1991, we are cloud and data engineering leaders providing solutions to fortune 100 enterprises, headquartered in Los Gatos, California, with development centers in NOIDA, Indore, Gurugram, Bengaluru, Pune, and Hyderabad with over 3000 global team members. We also have offices in Canada and Australia and collaborate with a number of established companies, including American Express, Bank of America, Capital One, Toyota, United Airlines, and Verizon.

Job Description

• 810 years of experience in data engineering or ETL development, with at least 4+ years in Google Cloud Dataflow.
• Good hands-on experience in Google Cloud Data Services (like Dataflow, Cloud Storage, BigQuery, Cloud Composer, Secret Manager, etc.).
• Strong understanding of ETL/ELT concepts and data migration of TB scale of data.
• Develop and optimize end-to-end data pipelines using Dataflow.
• Develop and implement generic, reusable pipelines for integrating incremental data.
• Expertise in leading a data processing team and delivering with quality.
• Ensure data quality throughout the data pipeline.

Roles & Responsibilities

• Have proficiency in design, implementation, and optimization of data engineering solutions over large volume (TB, PB scale) of data using GCP data services.
• Proven expertise in GCP services including Dataflow, BigQuery, Cloud Storage, Cloud Composer, Cloud Functions. Experience building scalable data lakes and pipelines.
• Proficiency in PySpark, Python, Spark SQL, and automating workflows.
• Have good exposure to writing optimized SQL (BigQuery SQL preferred).
• Have good communication and problem-solving skills.
• Able to create POC to achieve the solutions and perform code reviews of team.
• Have understanding of GenAI technologies and able to implement solutions using GenAI, code assist frameworks (CoPilot, Windsurf, etc.).
• Good to have: Dataproc