Senior DataBricks Architect

Job Title: Senior Databricks Architect

Experience: 1420 Years

Location - Bangalore, Hyderabad, Chennai, Gurgaon, Pune, Kolkata

Company Profile:-

Key Responsibilities

• Design and own end-to-end RGM data platform architecture on Azure using Databricks , supporting pricing, promotion, and POS analytics for CPG clients.
• Lead the architecture and implementation of Azure Lakehouse solutions , following Medallion (BronzeSilverGold) design principles.
• Provide deep technical leadership in Databricks and Azure Data Engineering, ensuring scalable, performant, and resilient solutions.
• Drive data assessment and profiling activities, including source system analysis, data quality gaps, granularity, latency, and readiness for analytics.
• Architect and implement robust, incremental data ingestion and processing frameworks for large-scale datasets.
• Build and oversee ADF and Databricks-based data pipelines , including orchestration, scheduling, monitoring, and failure handling.
• Design and govern dimensional data models (facts & dimensions) optimized for RGM analytics and downstream BI/reporting.
• Ensure data governance, quality, and observability , including lineage, completeness, accuracy, and timeliness across the platform.
• Implement security best practices using Azure RBAC, managed identities, and secure data access patterns within Databricks and ADLS.
• Optimize Databricks cluster configurations and compute usage to balance performance and cost efficiency.
• Act as a trusted client-facing architect , translating business requirements into technical solutions and presenting architecture to senior stakeholders.
• Collaborate with cross-functional teams (data engineers, analysts, product owners) and mentor junior architects and engineers .
• Stay current with Azure and Databricks advancements and continuously improve platform design, standards, and best practices.