Lead Consultant - Databricks Platform Engineer!

Genpact

5 - 10 years

Kolkata

Posted: 29/11/2024

Job Description

Responsibilities


  • Design and implement data architecture leveraging technologies such as AWS.

  • Set up Unity Catalog,- Should have specific experience setting up Unity Catalog

  • Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality.

  • Design and maintain data models and schemas, incorporating Unity Catalog data governance practices.

  • Ensure data security and compliance with regulations using Databricks.

  • Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.

  • Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.

  • Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.

About Company

Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.

Services you might be interested in

One-Shot Campaign

Reach out to ideal employees in one shot!

The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).