Senior Product Manager

About TrueFoundry

Every production AI systemwhether it's powering customer support, writing code, analyzing financial data, or diagnosing medical conditionsneeds the same foundational infrastructure.A way to route between models. A way to manage tools and integrate them securely. A way to orchestrate agents and enforce governance. A unified compute layer to run it all.

That infrastructure layer is being built right now.

We're TrueFoundry, and we're building it. We're looking for a Senior Product Manager to join the team.

The Problem We're Solving

Companies are moving beyond simple chatbots to production agentic systems. These systems route between OpenAI, Anthropic, Google, and self-hosted models. They integrate dozens of tools via protocols like MCP. They orchestrate multi-agent workflows where agents coordinate with other agents.

The infrastructure to support this doesn't exist yet. You can't just duct-tape together a few API calls and call it production-ready.

You need a control plane that handles:

• Intelligent routing with observability, cost policies, and fallback logic
• Centralized tool and MCP server management with security and lifecycle controls
• Agent orchestration with governance and guardrails
• A unified compute layer to run self-hosted models, custom tools, and agents

We've built two products to solve this:

AI Gateway is the control planefive composable components (Prompts, LLM Gateway, MCP Gateway, Guardrails, Agent Gateway) that handle routing, orchestration, and governance.

AI Deploy is the compute layera Kubernetes-based platform that abstracts ML workloads as standard software primitives, so everything runs on unified infrastructure.

We're Series A, backed by Intel Capital and Sequoia. Companies like CVS, Mastercard, Siemens, Paytm, Synopsys, and Zscaler run production AI workloads on our platform.

Responsibilities:

• Shape the agentic ops component of our product which could involve components like agent / tools catalog, LLM tracing, Evals etc
• User interviews, identification of pain points, translating that into requirements.
• Working with the design team to create end to end UX flows- both on the UI layer but also on the API layer
• Work with the dev team to ensure the requirements and UX is implemented well and to the timeline
• Ensure adoption of the product by working with the Customer Success team and close the feedback loop

Who You Are:

• Engineering background, 2+ years as a SWE, 4+ years as a PM
• PM experience on agentic development and / or ML devtools is a must

Benefits at TrueFoundry:

• Work on cutting edge of ML & Infrastructure.
• Be part of a fast growing product and team and help shape GenAI as an entire space.
• Hybrid work setup, Flexible working hours and work directly with the Co-founders.
• Insights for those who want to build a startup in the future
• Market compensation and participation in stock grants