Lead Data Engineer

Years of Experience: 8 to 13 years

Job Location: Bangalore/Pune/Kochi

Work Mode: Hybrid

Must Have Skills: Data Engineer, ETL/DWH, Databricks, SQL

Job Summary:

We are seeking a seasoned Databricks Integration Manager to lead the design, implementation, and optimization of Databricks-based data solutions. The ideal candidate will have deep expertise in cloud platforms (especially AWS or Azure), data engineering, and integration strategies, with a strong background in managing cross-functional teams and delivering scalable data platforms.

Key Responsibilities

• Lead end-to-end integration of Databricks with enterprise data platforms and cloud services.
• Collaborate with data architects, engineers, and business stakeholders to define integration strategies.
• Design and implement scalable data pipelines using Databricks, Spark, and cloud-native tools.
• Manage role-based access controls, Unity Catalog, and secure data environments.
• Ensure compliance with data governance, security, and performance standards.
• Provide technical leadership and mentorship to junior engineers and analysts.
• Coordinate with vendors and internal teams for smooth deployment and support.

Required Skills & Qualifications

• 813 years of experience in data engineering, cloud integration, or DevOps roles.
• Strong hands-on experience with Databricks, Spark, Python, and YAML.
• Deep understanding of AWS/Azure cloud architecture, Unity Catalog, and network security.
• Experience with CI/CD tools and infrastructure as code.
• Proven ability to manage complex projects and cross-functional teams.
• Excellent communication and stakeholder management skills.

Educational Qualification: BE/BTech/ MTech/ MCA