QA Automation Test Engineer- Python

Python Automation Test Engineer:

5-8yrs

Location: Hyderabad

Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deepchecks, Ragas and LangChain.

Key Requirements (8 Points) :

1. Test LLM outputs on AWS Bedrock using boto3.
2. Validate fine-tuned LLMs on AWS SageMaker with deepchecks.
3. Verify langchain prompts in AWS environments.
4. Test RAG pipelines with AWS OpenSearch and langchain.
5. Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
6. Test n8n agentic workflows (e.g., n8n.io/workflows/6270 ).
7. Ensure deployment stability on Amazon ECS/EKS with Docker.
8. Monitor performance with Amazon CloudWatch and wandb.

Must-Have Skills :

• 2 years testing GenAI/LLMs using Python
• 4+ years experience in QA Automation
• Expertise in AWS Bedrock, SageMaker, Lambda, boto3.
• Proficiency in deepchecks, langchain, crewai, autogen, wandb.
• Experience testing n8n workflows, RAG, prompts.