AI Data Architect

About Position:

We are seeking an experienced AI Data Architect with 12+ years of experience to lead the design and delivery of scalable AI and LLM-driven systems. This role focuses on architecting production-grade AI applications, including chatbots and agent-based systems, ensuring optimal performance, cost efficiency, and security. The ideal candidate will have deep expertise in building enterprise AI platforms, integrating data ecosystems, and establishing best practices for robust and responsible AI development.

• Role: AI Data Architect
• Location: Pune
• Experience: 12+ Years
• Job Type: Full Time Employment

What You'll Do:

• Proven experience designing and delivering production AI / LLM / chatbot / agent systems
• Experience defining architecture for scalable, multi-service AI applications
• Experience optimizing LLM cost, latency, and throughput in real-world deployments
• Experience integrating structured data platforms, APIs, and data warehouses into chatbot / agent workflows (not limited to RAG use cases)
• Experience designing testing, evaluation, and validation strategies for LLM-based systems
• Experience implementing rate limiting, throttling, quota management, and cost controls
• Experience with prompt engineering, system prompt design, and agent/tool orchestration
• Experience building multi-step / multi-agent / tool-calling AI workflows
• Experience with observability, logging, tracing, token tracking, and cost monitoring for AI systems
• Experience mitigating hallucinations, prompt injection, unsafe output, and data leakage
• Experience implementing security controls, RBAC, and data access boundaries in AI applications
• Experience working with multiple model providers and selecting models based on cost / latency / quality / reliability tradeoffs
• Experience designing high-performance backend services supporting AI workloads
• Experience with caching, batching, async processing, and parallel execution patterns
• Experience deploying AI systems in cloud environments with CI/CD, feature flags, and staged rollout
• Experience working with engineering teams to define standards, guardrails, and best practices for AI development

Expertise You'll Bring:

• Experience leading or advising teams building enterprise AI platforms
• Experience with agent frameworks / orchestration frameworks
• Experience with LLM evaluation frameworks and automated scoring
• Experience designing governance and usage policies for AI systems
• Experience with large-scale usage where cost management is critical
• Experience supporting customer-facing AI features in production
• Experience debugging complex behavior across prompts, tools, models, and data sources

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Lets unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.