Lead Consultant-Databricks Platform Engineer

Genpact

5 - 10 years

Noida

Posted: 9/3/2024

Job Description

Responsibilities



·         Design and implement data architecture leveraging technologies such as AWS.

·         Set up Unity Catalog,- Should have specific experience setting up Unity Catalog

·         Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality.

·         Design and maintain data models and schemas, incorporating Unity Catalog data governance practices.

·         Ensure data security and compliance with regulations using Databricks.

·         Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.

·         Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.

·         Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.


Qualifications
Minimum qualifications
years of experience in Data engineering or related field

Core Skills:
Data Platform Engineer with Databricks and Unity Catalog.



 

About Company

Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.

Services you might be interested in

One-Shot Campaign

Reach out to ideal employees in one shot!

The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).