Prompt Engineer

Job Title: Senior Prompt Engineer

Location: Hyderabad Onsite (5 Days a Week)

Experience: 5+ Years (Minimum 3+ Years in AI/LLMs)

Our client is hiring a highly technical Senior Prompt Engineer with strong Python backend expertise to build production-grade LLM systems. This is strictly not a content-writing role.

The ideal candidate must have deep experience in LLM behavior, structured prompting, guardrails, evaluation frameworks, and scalable AI architecture. If you cannot write production-level Python code, this role is not the right fit.

Responsibilities

• Design complex, multi-step, system-level prompts
• Build structured output prompts with strict JSON schema enforcement
• Implement few-shot, chain-of-thought, self-consistency, and tool-calling patterns
• Reduce hallucinations using grounding and validation strategies. Optimize token usage, latency, and response determinism
• Develop AI microservices using FastAPI or Flask. Implement streaming responses and async pipelines. Write modular, scalable, production-grade Python code
• Handle retries, fallbacks, rate limiting, and caching. Integrate LLM APIs (OpenAI, Claude, Gemini, Bedrock)
• Implement response validation layers and automated moderation filters
• Enforce schema validation before response delivery. Build deterministic output pipelines
• Develop automated evaluation frameworks. Define and measure accuracy, faithfulness, relevance, latency, and cost per request
• Run A/B prompt testing and continuous optimization. Implement Retrieval-Augmented Generation (RAG) pipelines
• Work with vector databases such as FAISS, Pinecone, or Weaviate. Build tool/function-calling integrations. Design multi-agent workflows using LangChain or LangGraph

Required Skills

• Expert-level Python (OOP, async programming, clean architecture)
• Strong experience integrating LLM APIs
• JSON schema design and validation
• Prompt debugging and optimization
• FastAPI / REST API development
• Git and version control
• Cloud exposure (AWS / Azure / GCP)

Must-Have Experience

• Building LLM systems in production
• Structured output enforcement
• Hallucination mitigation strategies
• Evaluation framework implementation
• Performance and latency optimization

Preferred

• Experience in healthcare or insurance AI systems
• Multi-agent orchestration
• MCP protocol exposure
• Voice or real-time AI systems

This is a high-impact engineering role focused on building reliable, scalable, production-ready AI systems. Serious backend engineers with applied LLM experience are encouraged to apply.