Quality Assurance Specialist

QA Lead AI & Intelligent Systems

Bangalore | Hyderabad | Pune

814+ Years Experience

We are hiring a QA Lead to drive the quality strategy for our Agentic AI platform. This role will own validation of AI agent behavior, reasoning accuracy, multi-agent workflows, and enterprise-grade reliability.

What Youll Do:

• Define QA strategy for AI/LLM-based systems
• Design testing frameworks for non-deterministic LLM outputs
• Validate agent reasoning, decision flows, and tool usage
• Build golden datasets and prompt evaluation benchmarks
• Lead functional, integration, regression & performance testing
• Integrate AI evaluation pipelines into CI/CD
• Drive automation across distributed systems

Must-Have:

• 814+ years in QA with leadership experience
• Strong background in distributed platforms & automation
• Experience in API testing, workflow testing & CI/CD
• Exposure to AI/ML or LLM-based systems

Good to Have:

• LLM evaluation frameworks
• Prompt testing tools
• Understanding of RAG, orchestration & agentic systems

This is a high-impact leadership role focused on making AI systems enterprise-ready, reliable, and safe.