Specialist - Quality Engineering

Role description

Sr Python GenAI Tester AWS Stack

Job Summary

Test generative AI solutions on AWS validating LLMs RAG prompts and agentic workflows with n8n and Python libraries like deepchecks and LangChain

Key Requirements 8 Points

1Test LLM outputs on AWS Bedrock using boto3

2Validate finetuned LLMs on AWS SageMaker with deepchecks

3Verify langchain prompts in AWS environments

4Test RAG pipelines with AWS OpenSearch and langchain

5Validate AI agents crewaiautogen on AWS Lambda

6Test n8n agentic workflows eg n8nioworkflows6270

7Ensure deployment stability on Amazon ECSEKS with Docker

8Monitor performance with Amazon CloudWatch and wandb

MustHave Skills

5 years of QA automation 2 years testing GenAILLMs using Python

Expertise in AWS Bedrock SageMaker Lambda boto3

Proficiency in deepchecks langchain crewai autogen wandb

Experience testing n8n workflows RAG prompts

Preferred Skills

AWS certification Machine LearningSolutions Architect

Familiarity with llamaindex n8n templates

Skills

Mandatory Skills : Agentic Framework,AI/Generative AI,Jenkins,User Acceptance Testing,Functional/System Testing,InSprint Testing,Regression Testing,SQL & Database testing,RTM -Testing,Selenium-Java -Testing,SIT -Testing,Test Design and Execution -Testing,Test Reports and Dashboards -Testing