Lead Consultant - Databricks Platform Engineer!
Genpact
5 - 10 years
Kolkata
Posted: 29/11/2024
Job Description
Responsibilities
-
Design and implement data architecture leveraging technologies such as AWS.
-
Set up Unity Catalog,- Should have specific experience setting up Unity Catalog
-
Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality.
-
Design and maintain data models and schemas, incorporating Unity Catalog data governance practices.
-
Ensure data security and compliance with regulations using Databricks.
-
Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.
-
Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.
-
Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.
About Company
Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).