Azure DevOps Engineer with Databricks

Azure Cloud & DevOps Specialist

(ADF Databricks AKS GitHub CI/CD)

Experience Required - 7 to 12 Years

Location - Indore/ Pune/ Chennai/ Bangalore

Role Summary

We are seeking a hands-on Azure Cloud & DevOps Specialist with proven, real-world experience automating deployments for data platforms and cloud-native applications on Microsoft Azure.

This role requires end-to-end ownership of CI/CD pipelines from Git-based workflows to production covering:

• Azure Data Factory (ADF)
• Databricks
• Azure SQL
• Microservices & containerized applications

Azure Platform Scope (Mandatory)

Candidates must have hands-on experience deploying and automating the following Azure services:

Data & Analytics

• Azure Data Factory (ADF)
• Azure SQL Database
• Databricks

Application & Compute

• Azure Function Apps
• Azure Web Apps
• Azure Container Apps
• Azure Kubernetes Service (AKS)

Caching

• Azure Redis Cache

Key Responsibilities

1 CI/CD & Deployment Automation (Core Responsibility)

• Design, implement, and maintain GitHub Actionsbased CI/CD pipelines for Azure workloads.
• Automate deployments for:
• ADF pipelines (ARM / Bicep / Terraform)
• Azure SQL schema & migrations
• Databricks notebooks, jobs, and workflows
• Delta Lake table definitions & schema evolution
• Enable environment promotion (Dev QA UAT Prod) with:
• Approval gates
• Rollback mechanisms
• Ensure zero manual deployments to production.

2 Azure Data Factory (ADF) Mandatory Hands-On

• Automates ADF deployments using:
• ARM templates / Bicep / Terraform
• Parameterized pipelines & linked services
• Implement:
• Incremental & CDC-based pipelines
• Retry logic, alerting & logging
• Integrate ADF CI/CD with GitHub Actions.

3 Database & Data Platform Automation

Azure SQL

• Automate schema changes using version-controlled SQL scripts
• Ensure backward-compatible deployments
• Implement rollback strategies

4 Databricks Deployment & CI/CD

Automate deployment of:

• Databricks notebooks
• Jobs & workflows

Using:

• Databricks CLI / REST APIs
• GitHub integration

Ensure workspace isolation across environments.

5 Application & Microservices Deployment

Deploy Python, Django, and React microservices to:

• Azure Function Apps
• Azure Web Apps
• Azure Container Apps
• AKS

Responsibilities include:

• Building & maintaining Docker images
• Managing Kubernetes manifests or Helm charts
• Implementing autoscaling, health checks & observability

6 Security, Secrets & Governance

• Manage secrets using Azure Key Vault
• Implement RBAC & managed identities
• Secure networking via VNets & private endpoints
• Enforce compliance & audit controls (financial data handling)

Required Skills & Experience (Non-Negotiable)

Core Requirements

• 5+ years in DevOps / Cloud Engineering
• 3+ years hands-on Azure experience
• Proven CI/CD automation for:
• Azure Data Factory
• Azure SQL
• Databricks

DevOps Tooling

• GitHub Actions (mandatory)
• Scripting: Python, Bash, or PowerShell

About InfoBeans:

InfoBeans is a global digital transformation and product engineering company, enabling businesses to thrive through innovation, agility, and cutting-edge technology solutions. With over 1,700 team members across the globe, we specialize in custom software development, enterprise solutions, cloud, AI/ML, UX, automation, and digital transformation services.

At InfoBeans, we live by our core purpose of Creating WOW!for our clients, team members, and the community. Our collaborative culture, growth opportunities, and people-first approach make us one of the most trusted and rewarding workplaces.