Senior AI/ML Python Engineer

Job Title: Senior AI/ML Python Engineer

Experience: 614 Years

Location: Hyderabad (Madhapur)

Notice Period: Immediate / 15 Days

Role Overview

We are seeking a highly skilled Senior AI/ML Python Engineer to design, build, and scale enterprise-grade AI solutions. The ideal candidate will have deep expertise in LLMs, agentic systems, and cloud-based AI platforms, along with strong software engineering fundamentals.

Key Responsibilities

• Design, develop, and deploy end-to-end AI solutions using Azure AI, Google Vertex AI, or similar cloud platforms.
• Architect advanced AI systems, including LLM integrations, agentic workflows, MCP-based solutions, RAG pipelines, and scalable microservices.
• Develop and maintain Python-based applications, RESTful APIs, and data processing pipelines.
• Establish and enforce engineering best practices across CI/CD, testing, observability, and model evaluation.
• Collaborate with product and business stakeholders to translate requirements into technical solutions and delivery roadmaps.
• Provide technical leadership through code reviews, architectural guidance, and mentoring.
• Ensure compliance with security, governance, and enterprise standards.
• Communicate technical strategies, risks, and progress effectively to leadership and cross-functional teams.

Mandatory Skills

• AI/ML, LLMs, Core AI
• Azure Cloud Platform
• MCP (Model Context Protocol)
• RAG (Retrieval-Augmented Generation)
• Docker & Kubernetes

Required Skills & Experience

LLM & Core AI

• Strong understanding of transformer architectures (attention mechanisms, tokens, context windows).
• Hands-on experience with multiple LLM providers (e.g., Azure OpenAI, Anthropic, Llama, Qwen).
• Expertise in handling context limits and optimizing model outputs.

Prompt Engineering & Context Design

• Experience designing structured, multi-layer prompts.
• Ability to build context-aware systems with history selection and tool integration.
• Experience with structured outputs (JSON/schema) and error handling.

Tools, MCP & Integrations

• Experience designing LLM tool schemas with validation and safe execution.
• Hands-on with MCP servers/tools including authentication and multi-tenant systems.
• Integration experience with REST APIs, SQL systems, and sandboxed environments.

Agentic Systems & Orchestration

• Experience building multi-step agent workflows (planning, execution, reasoning).
• Familiarity with agent roles (Planner, Worker, Critic, Router, Supervisor).
• Experience with frameworks like LangChain, LangGraph, Temporal, or similar.
• Knowledge of Agent-to-Agent (A2A) collaboration patterns.

RAG & Knowledge Systems

• End-to-end experience building RAG pipelines (ingestion to response synthesis).
• Expertise in hybrid search (vector + keyword + filters).
• Experience working with enterprise data sources (PDFs, SharePoint, SQL, etc.).

Reasoning, Evaluation & Guardrails

• Implementation of reasoning frameworks like ReAct and self-critique loops.
• Experience defining evaluation metrics and testing frameworks.
• Knowledge of observability, telemetry, and cost tracking.
• Strong understanding of AI safety, guardrails, and prompt injection defenses.

Model Performance & Optimization

• Experience optimizing cost, latency, and performance of LLM systems.
• Knowledge of caching, routing models, and parallel execution strategies.

Software Engineering & DevOps

• Expert in Python, REST API development, and microservices architecture.
• Experience with FastAPI, Flask, Django, and OpenAPI/Swagger.
• Strong background in Docker and Kubernetes deployments.
• Familiarity with data engineering, SQL/NoSQL databases, and event-driven systems.
• Experience with CI/CD pipelines, MLOps, infrastructure-as-code, and monitoring tools.