Databricks Architect

Were Hiring | Azure Databricks Architect

KPI Partners is seeking a skilled Azure Databricks Architect to join our dynamic team and help design, build, and scale enterprise-grade data platforms on Microsoft Azure .

The ideal candidate will have a strong background in working on challenging, large-scale, and multi-year data transformation projects . This is an excellent opportunity for a talented data professional to play a key role in delivering innovative data solutions using Azure native services and modern data engineering practices.

If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems , this role is for you.

Role: Azure Databricks Architect

Experience: 10+ years (Data Engineering / Architecture)

Location: Hybrid- Bangalore/Hyderabad/Pune

Key Responsibilities

• Design and implement Azure Databricks Lakehouse architecture
• Lead data ingestion and transformation using Azure Data Factory
• Define data models and optimize Spark & Delta Lake workloads
• Implement CI/CD pipelines using Azure DevOps
• Architect solutions using IaC (Terraform / Bicep)
• Ensure data security, governance, and cost optimization
• Collaborate with business and technical stakeholders

Required Skills & Experience

• 7+ years of experience in Data Engineering / Data Architecture
• Strong hands-on experience with Azure Databricks
• Proficiency in PySpark ,advanced SQL, Python
• Expertise in Azure Data Lake , Azure Data Factory (ADF)
• Experience with Spark, Delta Lake
• Exposure to enterprise-scale data transformation initiatives

Nice to Have

• Unity Catalog, MLflow, Azure ML
• Streaming technologies (Event Hub / Kafka)
• Experience with GenAI / ML workloads on Databricks

#Hiring #AzureDatabricks #DatabricksArchitect #AzureJobs #DataArchitecture #BigData #DataEngineering