DataBricks Engineer

Role: Databricks Engineer

Locations: Hyderabad / Coimbatore / Pune

Experience: 69 Years

Role Overview:

We are looking for a skilled Databricks Engineer with strong expertise in building scalable data solutions. The ideal candidate should have hands-on experience in big data processing, data engineering, and cloud-based data platforms.

Key Responsibilities:

Design, develop, and optimize data pipelines using Databricks

Implement data processing solutions using PySpark / Python

Build and manage data architecture following Medallion Architecture (Bronze, Silver, Gold layers) Work with Unity Catalog for data governance and security

Integrate and manage data workflows with Azure Synapse

Implement and maintain CI/CD pipelines for data engineering workflows

Collaborate with cross-functional teams to deliver scalable data solutions

Ensure data quality, performance tuning, and troubleshooting

Required Skills:

Strong hands-on experience with Databricks

Proficiency in PySpark or Python

Experience with Unity Catalog

Good understanding of Medallion Architecture

Exposure to Azure Synapse Analytics

Experience in implementing CI/CD pipelines

Strong problem-solving and analytical skills

Good to Have:

Experience working in cloud environments (Azure preferred)

Knowledge of data governance and security best practices