AI Tester

Job Title: AI Tester

Location: Remote

Job Summary:

We are looking for an AI Tester with strong experience in validating AI/ML models, Generative AI applications, and LLM-based systems.

The candidate will be responsible for ensuring the accuracy, reliability, safety, and performance of AI-powered products through specialized testing techniques including model validation, prompt testing, and bias detection.

Key Responsibilities:

Test AI/ML models and Generative AI applications for accuracy, reliability, and performance.

Validate LLM responses to ensure correctness, relevance, and safety.

Perform prompt testing and prompt validation for AI chatbots and AI assistants.

Design and execute test cases for AI models, including edge cases and adversarial inputs.

Evaluate model hallucinations, bias, toxicity, and fairness issues.

Conduct data validation testing to ensure training and testing datasets are clean and unbiased.

Collaborate with AI Engineers, Data Scientists, and Product teams to improve model quality.

Should have experience with XPath, JavaScript, Playwright.

Test AI APIs and integrations across applications and platforms.

Build automated testing frameworks for AI systems.

Monitor model performance metrics such as accuracy, precision, recall, and F1 score.

Document test results and provide recommendations for improvements.