Senior Databricks Data Engineer

We are hiring a Senior Databricks Data Engineer with strong expertise in Databricks, PySpark, and Azure Data Engineering to build scalable, high-performance, and cloud-native data solutions. The ideal candidate should have hands-on experience in ETL pipeline development and modern data lake architectures.

Location: Pune / Mumbai

Experience: 58 Years

Preferred Notice Period: Immediate Joiners to 30 Days

Mandatory Certifications :

Candidates should hold at least one of the following certifications :

• Microsoft Certified: Azure Data Engineer Associate
• Databricks Certified Associate Developer for Apache Spark

Key Responsibilities :

• Design, develop, and manage scalable data pipelines using Databricks and PySpark.
• Develop and optimize ETL workflows for large-scale data processing environments.
• Implement strong data quality frameworks and maintain data consistency across platforms.
• Integrate data from various sources including APIs, databases, and cloud-based data lakes.
• Optimize Spark and PySpark workloads for enhanced performance and resource utilization.
• Work extensively with Delta Lake for reliable, scalable, and version-controlled data storage.
• Migrate and optimize traditional stored procedures into Databricks-based solutions.
• Manage schema evolution and contribute to scalable data architecture design practices.

Mandatory Skills :

• Strong hands-on expertise in Databricks and PySpark.
• Experience working with Azure Databricks and modern cloud-based data engineering solutions.
• Proven experience in ETL pipeline development and Spark performance optimization.
• Strong understanding of Delta Lake and distributed data processing concepts.
• Experience integrating data from APIs, databases, and cloud storage platforms.
• Good knowledge of big data technologies and scalable data architectures.