Azure Databricks Architect

Azure Databricks Architect - Noida, Pune,Chennai,Bangalore,Hyderabad

Years of experience - 9-16 years

Notice period- Immediate to Serving to 30 days

Role Overview:

We are looking for experienced Data Architects / Senior Data Architects to join our team. In this role, you will lead the architecture, design, and delivery of modern data platformsincluding Data Lakes, Lakehouses, and Data Meshusing Azure and Databricks. This is a hybrid role involving hands-on development, customer engagement, and technical leadership, where you will collaborate across teams to drive scalable and innovative data solutions end-to-end.

Key Responsibilities:

• Architect and implement data solutions leveraging Azure and the Databricks ecosystem.
• Own the complete lifecycle of data platform implementationsfrom requirements gathering and platform selection to architecture design and deployment.
• Work closely with data scientists, application developers, and business stakeholders to deliver enterprise-grade data solutions.
• Continuously explore emerging technologies to solve business problems creatively.
• Mentor and guide a team of data engineers, promoting best practices and innovation.
• Contribute to broader organizational initiatives including capability building, solution development, talent acquisition, and industry events.

Required Qualifications:

• 8+ years of overall technical experience with at least 4 years working hands-on with Microsoft Azure and Databricks.
• Experience of leading at least 2 end to end Data Lakehouse project on Azure Databricks involving Medallion Architecture.
• Deep expertise in the Databricks ecosystem , including: PySpark, Notebooks, Unity Catalog, Delta Live Tables, Workflows, SQL Warehouse, Mosaic AI, AI/BI Genie.
• Hands-on experience building modern data platforms on Azure using tools and services such as: Azure Databricks, Azure Data Factory, ADLS Gen2, SQL Database, Microsoft Fabric, Event Hub, Stream Analytics, Cosmos DB, Azure Purview, Log Analytics, and Azure Explorer.
• Experience of designing and developing metadata-driven frameworks (relevant for Data Engineering processes).
• Strong programming , debugging, and performance tuning skills in Python and SQL.
• Good Experience of Data modeling (both Dimensional and 3-NF)
• Good Exposure to developing LLM/GenAI-powered applications.
• Sound understanding of CI/CD processes using Git and Jenkins or Azure DevOps.
• Familiarity with big data platforms such as Cloudera (CDH) or Hortonworks (HDP) is a plus.
• Exposure to technologies like Neo4j, Elasticsearch, and vector databases is desirable.
• Bonus: Experience with Azure infrastructure provisioning, networking, security, and governance.

Educational Background:

• Bachelors degree (B.E/B.Tech) in Computer Science, Information Technology, or a related field from a reputed institute (preferred).