Azure Architect (Databricks Platform & Data Engineering)

Your Team Responsibilities

Your Key Responsibilities

• Architect and implement Azure-based data solutions using Databricks, Data Factory, Synapse Analytics, and Data Lake services.

• Design, build, and optimize a Medallion architecture (Bronze, Silver, Gold) supporting both HR and enterprise data domains.

• Develop data pipelines, APIs, and orchestration frameworks that enable seamless data ingestion, transformation, and delivery.

• Establish and maintain data governance, metadata, and lineage frameworks using Databricks Unity Catalog and Azure Purview.

• Build and maintain ETL/ELT frameworks, data APIs, and real-time workflows connecting diverse HR and enterprise systems.

• Leverage AI and ML capabilities within Databricks, including MLflow, feature stores, and the Agent Framework (Agent Bricks), to build intelligent data agents for automation, monitoring, and analytics enrichment.

• Design and implement AI agent pipelines that can reason over HR data models, automate transformations, and enhance analytical outcomes.

• Apply best practices for performance optimization, scalability, and cost efficiency within the Azure ecosystem.

• Integrate CI/CD pipelines and infrastructure-as-code approaches (Terraform, Bicep, or Azure DevOps).

• Serve as the technical authority for Azure and Databricks architecture within HR Technology.

• Partner with HR, Analytics, and Infrastructure leaders to define and execute the data and AI modernization roadmap.

• Establish standards, patterns, and reusable frameworks for data engineering, AI agents, and automation.

• Mentor engineers and champion a culture of innovation, experimentation, and delivery excellence.

Your skills and experience that will help you excel

• Education: Bachelor’s or Master’s degree in Computer Science, Information Systems, or related field.

• Experience: Minimum 12 years of hands-on experience architecting and delivering large-scale data platforms using Azure and Databricks.

• Proven success in deploying Medallion architectures, governed data pipelines, and AI-driven data workflows.

• Expertise in:

  • Azure Data Lake, Data Factory, and Synapse Analytics

  • Databricks (Delta Lake, Unity Catalog, Spark optimization)

  • Python, SQL, PySpark, and API development (REST, GraphQL)

  • Infrastructure as code (Terraform, Bicep) and DevOps automation

  • AI/ML frameworks within Databricks, including Agent Bricks and MLflow

• Strong grounding in data governance, security, and compliance best practices.

• Excellent communication and collaboration skills; ability to translate complex architecture into business outcomes.

• Knowledge of Azure Purview, Power BI, and data cataloging tools.

• Experience implementing Databricks Unity Catalog, Delta Live Tables, and AI agent orchestration within enterprise contexts.

• Familiarity with HR data models and effective design for analytics and workforce intelligence.

• Understanding of LLM integration and AI agent frameworks for data enrichment and automation.