Login Sign Up

Engineering Manager - AI Agentic Platform

AIONOS

5 - 10 years

Hyderabad

Posted: 14/05/2026

Getting a referral is 5x more effective than applying directly

Job Description

Engineering Manager

AI Agentic Platform Orchestration, Benchmarking & Unification

About the Role

We are seeking an experienced Engineering Manager to build, architect, and lead the team behind our next-generation AI Agentic Platform. This platform empowers enterprises to measure ROI on industry-specific agent activity, benchmark AI agents against performance standards, orchestrate complex multi-agent workflows, and unify AI agents seamlessly across diverse platforms and ecosystems.

As the engineering leader for this strategic product, you will combine deep technical expertise with strong people management skills to deliver a unified control plane for the rapidly evolving agentic AI landscape. You will own the technical vision, drive architectural decisions, and grow a high-performing team that ships at the frontier of AI engineering.

Platform Capabilities You'll Own

  • Industry-Specific ROI Measurement: Build instrumentation, analytics, and reporting frameworks that quantify the business impact of AI agents across verticals such as BFSI, healthcare, retail, and telecom.
  • AI Agent Benchmarking: Develop standardized evaluation harnesses, performance scoring, and quality metrics that allow enterprises to compare agents on accuracy, latency, cost, safety, and task success.
  • Agent Orchestration: Design multi-agent orchestration engines, workflow planners, routing layers, and coordination frameworks that enable agents to collaborate on complex tasks reliably.
  • Cross-Platform Agent Unification: Architect a unified abstraction layer, connectors, and protocol adapters (MCP, A2A, OpenAI Assistants, LangGraph, etc.) so customers can manage agents across vendors and frameworks from a single pane of glass.


Key Responsibilities

  • Hire, build, and lead a high-caliber engineering team across backend, AI/ML, and platform infrastructure
  • Define and own the technical architecture for a multi-tenant, scalable AI agentic platform
  • Drive the technical roadmap for orchestration, benchmarking, observability, and unification capabilities
  • Partner with Product, Design, Data Science, and GTM teams to translate customer needs into shippable engineering outcomes
  • Establish engineering best practices for AI agent development, evaluation, safety, and deployment
  • Lead architectural reviews, design discussions, and technical decision-making for complex distributed systems
  • Build robust evaluation frameworks and ROI dashboards that customers and internal teams trust
  • Ensure platform reliability, performance, security, and cost efficiency at scale
  • Mentor engineers, set growth paths, run performance reviews, and foster an inclusive, high-trust team culture
  • Communicate progress, risks, and strategic recommendations to executive leadership


Required Qualifications

  • 8+ years of software engineering experience with at least 3+ years managing engineering teams
  • Proven experience architecting and scaling distributed systems, microservices, and cloud-native platforms
  • Hands-on experience building AI/ML or LLM-powered products in production environments
  • Strong understanding of agentic AI concepts including planning, tool use, memory, and multi-agent coordination
  • Proficiency in modern programming languages such as Python, Go, Java, or TypeScript
  • Experience designing APIs, SDKs, and integration platforms used by enterprise customers
  • Track record of recruiting, developing, and retaining strong engineering talent
  • Strong communication, stakeholder management, and cross-functional collaboration skills
  • Experience with cloud platforms (AWS, GCP, or Azure), containerization (Docker, Kubernetes), and CI/CD pipelines
  • Bachelor's degree in Computer Science, Engineering, or equivalent practical experience


Preferred Qualifications

  • Experience building agent orchestration frameworks (LangGraph, CrewAI, AutoGen, Semantic Kernel, or similar)
  • Familiarity with emerging agent interoperability standards such as Model Context Protocol (MCP) and Agent-to-Agent (A2A) protocols
  • Experience designing LLM evaluation and benchmarking systems (offline evals, A/B testing, golden datasets, judge models)
  • Knowledge of observability for AI systems including tracing, telemetry, and cost/quality monitoring
  • Experience with retrieval-augmented generation (RAG), vector databases, and prompt engineering at scale
  • Background in building analytics, ROI dashboards, or business intelligence tooling for enterprise customers
  • Domain experience in one or more verticals (BFSI, healthcare, retail, telecom, customer support, or sales)
  • Familiarity with AI safety, guardrails, and responsible AI frameworks
  • Master's degree in Computer Science, AI/ML, or related field


Technical Stack & Tooling

  • Languages: Python, Go, TypeScript/Node.js, Java
  • AI/ML Frameworks: LangChain, LangGraph, LlamaIndex, Hugging Face, PyTorch, OpenAI/Anthropic/Google APIs
  • Agent Protocols: MCP, A2A, OpenAI Assistants API, function calling, tool use frameworks
  • Data & Storage: PostgreSQL, MongoDB, Elasticsearch, Pinecone/Weaviate/Qdrant, Snowflake/BigQuery
  • Streaming & Messaging: Kafka, Redis, RabbitMQ, gRPC
  • Cloud & Infra: AWS, GCP, Azure, Kubernetes, Terraform, Docker
  • Observability: Datadog, OpenTelemetry, LangSmith, Langfuse, Prometheus, Grafana


What We're Looking For

  • A builder-leader who can both architect deeply technical systems and grow a high-performing team
  • Someone genuinely excited about agentic AI and the future of multi-agent enterprise systems
  • A pragmatic decision-maker who can balance innovation, customer value, and engineering excellence
  • A strong communicator who can simplify complex AI concepts for diverse audiences
  • A coach and mentor who invests in people and builds inclusive, psychologically safe teams


Why Join Us

  • Lead one of the most strategic AI initiatives at the company at the forefront of agentic AI
  • Build a category-defining platform that unifies, benchmarks, and orchestrates AI agents across the enterprise
  • Shape product and technical strategy alongside senior leadership
  • Work with cutting-edge LLMs, agent frameworks, and evaluation tooling
  • Competitive compensation, equity, and comprehensive benefits
  • Flexible work culture with strong investment in learning and development


We are an equal opportunity employer committed to building a diverse and inclusive team. We welcome applications from candidates of all backgrounds.

Services you might be interested in

Improve Your Resume Today

Boost your chances with professional resume services!

Get expert-reviewed, ATS-optimized resumes tailored for your experience level. Start your journey now.