AI Platform Engineer

Job Description

We are seeking a highly skilled AI Platform Engineer to design, build, and operate our next-generation AI application platform . In this role, you will work on advanced AI systems including Retrieval-Augmented Generation (RAG) pipelines, multi-model gateways , Model Context Protocol (MCP) tools , agentic workflow automations (e.g., n8n), and secure chat interfaces such as OpenWebUI or custom-built solutions .

You will be responsible for ensuring the production readiness of all platform componentscovering Infrastructure as Code (IaC) , CI/CD pipelines , Kubernetes orchestration , observability , cost optimization , and governance . This role will work closely with product, data, and security teams to deliver scalable, secure, and high-performing AI-driven applications.

Key Responsibilities

• Design, develop, and operate the companys AI application platform , including RAG pipelines, model gateways, MCP integrations, and agent workflows.
• Build and maintain secure chat interfaces using OpenWebUI or custom UI components.
• Own IaC (Terraform, Helm, etc.) , CI/CD automation , and Kubernetes -based deployments for all AI platform components.
• Implement robust observability solutions (monitoring, logging, tracing) across the platform.
• Ensure platform reliability, uptime, and scalability using SRE and DevOps best practices.
• Optimize compute, storage, and inference costs while maintaining performance and quality.
• Establish strong governance , access control, and compliance processes across AI workloads.
• Collaborate cross-functionally with product, data science, engineering, and security to deliver high-impact AI features and integrations.
• Troubleshoot production issues and continuously improve the platforms architecture and performance.

Required Skills & Qualifications

• 410+ years of experience in software engineering, DevOps, or AI/ML platform engineering .
• Strong hands-on programming experience in Python, Go, or TypeScript .
• Expertise with Kubernetes , container orchestration, and cloud-native tooling.
• Proficiency with Terraform , Helm , or other IaC frameworks.
• Experience building RAG pipelines , LLM integrations , or similar AI workflows.
• Familiarity with n8n , LangChain , OpenWebUI , or custom chat interface frameworks.
• Solid understanding of observability tools (Prometheus, Grafana, ELK, OpenTelemetry).
• Experience with secure, production-grade deployments of AI or distributed systems.

Preferred Qualifications

• Experience with multi-model routing, inference gateways, or vector databases.
• Knowledge of MCP (Model Context Protocol) and related developer tooling.
• Prior experience scaling AI or distributed systems in cloud environments (AWS, GCP, Azure).
• Understanding of SRE principles, access governance, and security best practices.