AI/ML Engineer (Azure Databricks)

Role: AI/ML Developer Azure Databricks

Type: Hybrid

Location: Noida, Bengaluru, Chennai, Pune or Hyderabad

Experience: 5+ Years

Budget: 7-11 LPA

Job Summary-

We are seeking an experienced AI/ML Developer with strong expertise in Azure Databricks, Python, PySpark, and SQL to design, develop, and deploy scalable machine learning and data engineering solutions. The ideal candidate will work closely with data scientists, architects, and business stakeholders to deliver high-impact AI/ML solutions on the Azure cloud platform.

Key Responsibilities-

Design, develop, and maintain end-to-end AI/ML solutions using Azure Databricks

Build and optimize data pipelines using PySpark and Spark SQL

Develop, train, evaluate, and deploy machine learning models in production environments

Perform data preprocessing, feature engineering, and model tuning

Implement scalable batch and streaming data solutions

Optimize Spark jobs for performance, cost, and reliability

Collaborate with data scientists to productionize ML models

Ensure best practices in code quality, testing, version control, and CI/CD

Work with large, complex datasets across structured and semi-structured sources

Monitor model performance and data drift in production

Document technical designs, workflows, and solutions

Required Skills & Qualifications-

5+ years of hands-on experience in AI/ML or data engineering roles

Strong proficiency in Python for data processing and ML development

Extensive experience with Azure Databricks

Solid expertise in PySpark and Spark SQL

Strong knowledge of SQL for complex data analysis and transformations

Experience building and deploying machine learning models (regression, classification, clustering, etc.)

Familiarity with ML libraries such as Scikit-learn, MLflow, TensorFlow, or PyTorch

Experience with Azure services such as:

Azure Data Lake Storage (ADLS)

Azure Synapse Analytics

Azure Machine Learning (preferred)

Understanding of ETL/ELT concepts, data warehousing, and big data architectures

Experience with Git and collaborative development workflows

Strong problem-solving and analytical skills

Excellent communication and stakeholder collaboration skills

Preferred / Nice-to-Have Skills-

Experience with real-time/streaming data (Kafka, Event Hubs, Structured Streaming)

Knowledge of MLOps practices, CI/CD pipelines, and model lifecycle management

Exposure to Delta Lake and data versioning

Experience with containerization (Docker) and orchestration tools

Understanding of data governance, security, and compliance in Azure

Domain experience in finance, healthcare, retail, or telecom (optional)