Sr. Generative AI Engineer with SAP
Saarthee
2 - 5 years
Bengaluru
Posted: 08/01/2026
Job Description
Position Summary:
We are looking for a Senior GenAI / LLM Engineer who can work independently and drive end-to-end GenAI use cases, from rapid prototyping to production deployment. The ideal candidate will have hands-on experience building and deploying GenAI solutions in production environments, a strong software engineering foundation, and deep expertise in the AWS ecosystem.
This role requires close collaboration with internal teams to build scalable, secure, and business-aligned GenAI applications.
Roles & Responsibilities:
GenAI Solution Development
- Design, build, and deploy GenAI solutions using LLMs, RAG, and prompt engineering to solve real-world business problems.
- Develop production-grade GenAI applications, ensuring scalability, reliability, and performance.
Rapid Prototyping & POCs
- Quickly build functional GenAI prototypes to validate business use cases within short timelines.
- Iterate rapidly based on feedback from stakeholders and performance metrics.
Model Selection & Optimization
- Evaluate and select appropriate foundation models (OpenAI, Anthropic, LLaMA, etc.) based on accuracy, latency, and cost.
- Fine-tune and adapt models for use cases such as enterprise Q&A, summarization, and personalized responses.
Data & System Integration
- Design and implement data ingestion pipelines to integrate enterprise data sources (documents, databases, APIs) into vector stores.
- Ensure seamless integration of GenAI solutions with existing enterprise systems and applications.
Feasibility & Production Readiness
- Assess POC performance, scalability, and cost to recommend readiness for production deployment.
- Provide technical guidance on architecture, security, and operational best practices on AWS.
Engineering & Collaboration
- Apply software engineering best practices while working on large, distributed systems.
- Communicate effectively with technical and non-technical stakeholders to explain design choices and solution outcomes.
Required Qualifications:
- Bachelors or Masters degree in Engineering, Computer Science, or a related field.
- 6+ years of experience in ML / software engineering roles, with proven GenAI production deployments.
- Strong understanding of AWS services and cloud-native architectures.
- Excellent communication skills and ability to work independently.
Nice to Have
- Knowledge of SAP systems or experience integrating GenAI solutions with SAP landscapes.
- Prior experience working on enterprise-scale platforms.
Services you might be interested in
Improve Your Resume Today
Boost your chances with professional resume services!
Get expert-reviewed, ATS-optimized resumes tailored for your experience level. Start your journey now.
