Lead Consultant-Databricks Platform Engineer
Genpact
5 - 10 years
Noida
Posted: 9/3/2024
Job Description
Responsibilities
· Design and implement data architecture leveraging technologies such as AWS.
· Set up Unity Catalog,- Should have specific experience setting up Unity Catalog
· Develop, optimize, and manage data pipelines for ETL processes using azure Databricks, with a focus on data integrity and quality.
· Design and maintain data models and schemas, incorporating Unity Catalog data governance practices.
· Ensure data security and compliance with regulations using Databricks.
· Establish a robust data governance strategy, defining standards, metadata management, lineage, and quality practices.
· Operationalize Machine Learning models in Batch and Real Time Data Pipelines, leveraging relevant governance setups.
· Collaborate with cross-functional teams including data scientists, engineers, and analysts to translate business requirements into scalable solutions.
Qualifications
Minimum qualifications
years of experience in Data engineering or related field
Core Skills:
Data Platform Engineer with Databricks and Unity Catalog.
About Company
Genpact is a global professional services firm delivering digital transformation by putting digital and data to work to create competitive advantage.
Services you might be interested in
One-Shot Campaign
Reach out to ideal employees in one shot!
The intelligent campaign for reaching out to the ideal audience to whom you can ask for help (guidance or referral).