Databricks Engineering

Job Title: Databricks Engineering

Job Location: Hyderabad, India

Job Type: Full Time

Experience Range: 5+ years

Key Responsibilities

• Design and build scalable, highperformance data pipelines using Databricks with PySpark and SQL on Azure
• Migrate legacy data warehouses and data lakes into modern Azure-based architectures
• Develop and orchestrate end-to-end ETL workflows using Azure Data Factory, including scheduling, data flows, linked services, and Databricks integration
• Work with Azure data services such as ADLS, Azure SQL Database, Azure Blob Storage, and Event Hubs
• Implement data security controls including ACLs, RBAC, and row or column level security
• Optimize data pipelines for performance, cost efficiency, and reliability within Azure
• Utilize Git-based CI/CD processes for ADF and Databricks deployments
• Support data governance, metadata management, and automation across Azure data environments

Essential Skills

• Databricks with strong PySpark and SQL expertise
• Azure Data Factory ETL development
• Azure data services including ADLS, Blob, SQL Database
• Data security implementation on Azure
• Performance tuning and cost optimization for data pipelines
• CI/CD with Git for ADF and Databricks

Optional Skills

• Experience with Event Hubs
• Exposure to data governance frameworks
• Metadata management tools
• Automation of Azure data workflows