Test Lead - Data AI Product

Role: Backend/API Test Automation Engineer

Key Responsibilities

• Design and execute automated tests for backend services and APIs (REST, JSON, authentication).
• Perform performance testing and integrate tests into CI/CD pipelines.
• Validate ML/LLM-based systems, including dataset evaluation, response accuracy, and guardrail/safety checks.
• Maintain clear documentation and ensure traceability within regulated product lifecycle frameworks (PDLM/QMS).
• Collaborate with cross-functional teams to ensure high-quality, secure, and compliant product releases.

Required Skills

• Strong hands-on experience in backend/API automation.
• Proficiency in Python or TypeScript.
• Experience with Postman/Newman, REST-assured, PyTest/Jest.
• Performance testing using k6 or JMeter.
• Experience working with Docker and CI/CD tools.
• Understanding of ML/LLM testing workflows (evaluation metrics, dataset validation, prompt testing).

Preferred / Bonus Skills

• Experience with Azure DevOps pipelines.
• Familiarity with FHIR/HL7 standards and healthcare data privacy/security.
• Basic frontend testing skills (preferred but not mandatory).