Senior AI Engineer

Role : Senior AI Engineer

Location: Bangalore/ Hybrid (3 days from office)

Minimum 6+ Years of Experience required.

Overview

We are seeking a senior-level engineer to build and support production-grade data and AI applications on Azure Databricks . This role is hands-on and focused on designing scalable pipelines, integrating ML and Generative AI models, and deploying reliable solutions in Azure cloud environments.

Responsibilities

• Design, develop, and deploy end-to-end data and AI pipelines using Azure Databricks .
• Build robust ETL/ELT workflows using PySpark and SQL for large-scale data processing.
• Integrate Databricks with Azure services (ADLS Gen2, Blob Storage, Key Vault, Azure OpenAI, Azure Functions).
• Implement and maintain CI/CD pipelines for Databricks jobs, notebooks, and workflows.
• Optimize pipelines for performance, scalability, reliability, and cost efficiency .
• Collaborate with data scientists and platform teams to move ML and Generative AI models into production.
• Implement logging, monitoring, error handling, and governance for production workloads.
• Support LLM-based solutions including embeddings, RAG pipelines, and inference workflows.

Required Skills & Experience

• Strong hands-on experience with Azure Databricks (jobs, workflows, clusters; Unity Catalog preferred).
• Expert-level Python with heavy PySpark usage (not just Pandas).
• Advanced SQL skills (complex joins, window functions, analytical queries).
• Solid experience with Azure Cloud services (ADLS Gen2, ADF, Key Vault, IAM concepts).
• Experience with CI/CD and environment promotion (Azure DevOps preferred).
• Understanding of ML lifecycle and MLOps best practices.
• Experience deploying models using MLflow or similar frameworks.

Nice to Have

• Experience with Generative AI workloads (LLMs, embeddings, RAG).
• Familiarity with Azure OpenAI , Hugging Face, or LangChain.
• Infrastructure as Code experience (Terraform, ARM, or Bicep).
• Airflow or ADF orchestration experience.
• Production monitoring and cost optimization experience.

Thank you,

Harish

Accounts Manager/Talent Acquisition

Astir IT Solutions, Inc - An E-Verified Company

Email:

Direct :