AI Automation Test Engineer (Playwright + Agentic AI)

Company Description

Infotech.Works (ITW) specializes in building innovative digital products and services for startups and leading brands. Leveraging a unique prototyping framework, APIs, and open-source software, ITW delivers high-quality and efficient solutions . The company serves diverse industries, including healthcare, education, gaming, startups, and enterprise businesses, offering services such as rapid prototyping, product design and development, and digital marketing strategy. Known for its focus on speed, affordability, and innovation, ITW has successfully collaborated with over 20 startups in the past year.

We are helping build an AI-powered application generation platform similar to Lovable, where users can create full applications using natural language prompts.

We are looking for a highly skilled Automation Test Engineer with deep expertise in Playwright and strong understanding of Agentic AI systems to design robust testing frameworks for AI-generated applications, prompt-driven workflows, and autonomous agents.

This role sits at the intersection of QA automation, AI systems, and modern web application testing.

• Develop scalable end-to-end automation frameworks using Playwright
• Test dynamic UIs generated by AI
• Automate browser flows, API validation, and integration tests
• Implement parallel test execution and CI/CD integration

Design tests that validate:

• Prompt Generated UI
• Prompt Generated backend APIs
• Prompt Database schema generation
• Prompt code updates or fixes

Ensure that AI-generated outputs behave as expected.

Validate multi-step AI systems including:

• agent orchestration
• tool invocation
• AI reasoning flows
• generated application behavior

Create test scenarios for complex agent workflows.

Develop strategies to test:

• structured LLM responses
• JSON output validation
• hallucination handling
• prompt injection vulnerabilities

• Work closely with product and AI teams
• Define testing strategies for AI systems
• Improve reliability of AI-generated features

Strong experience with:

• Playwright automation framework
• browser automation
• parallel test execution
• API mocking
• dynamic selector handling
• TypeScript or JavaScript

Hands-on knowledge of:

• LLM workflows
• prompt engineering
• agentic AI architectures
• AI output validation

Experience working with tools such as:

• OpenAI API
• LangChain
• CrewAI

Experience with:

• REST API testing
• GraphQL
• JSON schema validation
• database validation

• 37 years in QA automation or test engineering
• 2+ years working with Playwright or similar frameworks

Pune- In office

You will work on cutting-edge AI systems where applications are generated through natural language. This role offers the opportunity to build next-generation QA frameworks for AI-native products.