Data Engineer – Unity Catalog Migration
Innova ESI
2 - 5 years
Bengaluru
Posted: 21/06/2026
Job Description
Role: Data Engineer Unity Catalog Migration
Location: Gurgaon
Experience: 5+ Years
Immediate Joiners
Senior Data Engineer - Unity Catalog Migration
- 5-8+ years in data engineering with proven large-scale migration experience (500+ notebooks minimum)
- Strong hands-on PySpark proficiency including RDD operations, DataFrame/Dataset APIs, and performance optimization
- Deep Unity Catalog migration experience: Hive metastore to UC, mount-to-volume patterns, RBAC implementation
- Testing: Perform end-to-end validation of Unity Catalog migrated notebooks, tables, volumes, and data pipelines to ensure functional correctness and data integrity.
- Hands-on experience with Azure Databricks, UCX tool, and Azure Data Factory orchestration
- Experience building code transformation tools, automation frameworks, or migration accelerators
- Strong documentation skills for technical patterns, runbooks, and knowledge transfer
Ability to work embedded with client teams in agile/sprint environments
Services you might be interested in
We Search & Apply Jobs for You!
Our team scans through 1000s of opportunities and applies to roles best suited to your profile
Save 100+ hours and focus on what matters - cracking interviews and landing offers.
