GCP Data Engineer

Skills Required:

Google Cloud Platform - Biq Query, Data Flow, Dataproc, Data Fusion, TERRAFORM, Tekton,Cloud SQL, AIRFLOW, POSTGRES, Airflow PySpark, Python, API, GitHub

Skills Preferred:

AI/ML

Experience Required:

Engineer 2 Exp: 4+ years Data Engineering work experience

Education Required:

Bachelor's Degree, Master's Degree

Education Preferred:

Certification Program

Additional Information :

Experience in building data pipelines in cloud. Experience in curating data for ML and statistical models Experience in using python/node js. Experience in performing Enterprise Data Architecture.

Description: Employees in this job function are responsible for designing, building, and maintaining data solutions including data infrastructure, pipelines, etc. for collecting, storing, processing and analyzing large volumes of data efficiently and accurately

Key Responsibilities:

1) Collaborate with business and technology stakeholders to understand current and future data requirements

2) Design, build and maintain reliable, efficient and scalable data infrastructure for data collection, storage, transformation, and analysis

3) Plan, design, build and maintain scalable data solutions including data pipelines, data models, and applications for efficient and reliable data workflow

4) Design, implement and maintain existing and future data platforms like data warehouses, data lakes, data lakehouse etc. for structured and unstructured data

5) Design and develop analytical tools, algorithms, and programs to support data engineering activities like writing scripts and automating tasks

6) Ensure optimum performance and identify improvement opportunities