7 + years experienced Solution Architect – Databricks & Cloud Data Platforms

Role Overview

We are looking for a 7+ years experienced Solution Architect with deep expertise in Databricks to design, implement, and optimize enterprise-scale data platforms. The ideal candidate will combine strong technical knowledge of big data, cloud-native architectures, and advanced analytics with the ability to engage stakeholders and translate business needs into scalable solutions.

Required Skills & Expertise

• Strong hands-on experience with Databricks (Delta Lake, MLflow, Unity Catalog) .
• Proficiency in Apache Spark, Python, SQL, and Scala .
• Experience with Azure Data Factory, Synapse, Event Hubs or equivalent AWS/GCP services.
• Knowledge of data governance frameworks and cloud security best practices .
• Proven track record in designing scalable architectures for large datasets (TBs to PBs).
• Ability to optimize performance and reduce costs in cloud environments.
• Excellent communication and stakeholder management skills.

• Architect and deliver end-to-end data solutions leveraging Databricks (Delta Lake, MLflow, Unity Catalog).
• Design and optimize data pipelines for batch and real-time processing using Spark, Kafka, and Event Hubs.
• Collaborate with business stakeholders to define requirements and translate them into technical architectures.
• Ensure governance, compliance, and security across data platforms, including role-based access and audit controls.
• Lead cloud migration initiatives from legacy systems to Databricks on Azure/AWS/GCP.
• Mentor engineering teams on best practices for Databricks, Spark optimization, and cost-efficient cloud usage.
• Drive innovation by integrating Databricks with BI tools, machine learning workflows, and enterprise data lakes.