QA Engineer – AI & Automation

Company Description

Radius is a tech-driven brokerage firm dedicated to empowering real estate professionals with tools and resources to grow their brands and optimize profitability. Offering services like networking, branding, marketing solutions, and end-to-end client support, Radius helps agents save time and money while expanding their businesses. Established in 2015, Radius benefits from the support of industry leaders, including the founders of Trulia, Zillow, and Roofstock. For more details, visit https://www.radiusagent.com/.

Role Description

This is a full-time, on-site role in Bengaluru for a QA Engineer AI & Automation. You will be responsible for ensuring the quality of both traditional applications (web & mobile) and AI-driven features across the Radius platform.

This role goes beyond standard QAyou will test LLM-powered features, AI automations, voice workflows, and intelligent systems, ensuring they are accurate, reliable, and safe for real-world usage.

You will work closely with engineering, product, and customer teams to triage complex issues, validate AI behavior, and build scalable test strategies.

Responsibilities:

Functional & AI Testing:

• Perform comprehensive black-box testing for web and mobile applications
• Validate AI-powered features, including:
• Chatbots & auto-replies
• AI-generated summaries & recommendations
• Workflow automations
• Evaluate AI outputs for:
• Accuracy, relevance, and consistency
• Hallucinations and edge cases
• Tone, safety, and bias

Test Strategy & Design:

• Develop test plans and strategies for both deterministic and AI-driven systems
• Create prompt-based test scenarios and AI evaluation datasets

Automation & Frameworks:

• Design, develop, and maintain automation frameworks using:
• Playwright
• Automate:
• End-to-end user flows (web & mobile)
• API workflows and AI responses
• Regression suites for AI features
• Integrate automation into CI/CD pipelines

API, DB & System Testing:

• Perform API testing using tools like Postman
• Validate backend systems using SQL (DB testing)
• Ensure data integrity across AI pipelines and workflows

Voice & Conversational Testing:

• Test AI voice and messaging features (e.g., SMS, calling workflows)
• Validate:
• Speech-to-text accuracy
• Intent recognition
• Multi-turn conversations
• Work with tools like Twilio

Performance, Analytics & Debugging

• Perform performance, scalability, and security testing
• Troubleshoot issues using:
• Analytics data
• Crash reports
• User-reported errors
• Investigate AI-specific issues like:
• Inconsistent responses
• Prompt failures

Qualifications

• Strong skills in Quality Control, Quality Assurance, and Quality Management
• Familiarity with Good Manufacturing Practices (GMP) and ability to ensure compliance
• Experience with Quality Auditing and maintaining quality standards
• Analytical mindset with excellent problem-solving and attention to detail
• Bachelors degree in a relevant field such as Computer Science, Engineering, or Quality Management
• Experience working with AI systems or software development is an advantage
• Strong collaboration and communication skills to work effectively with diverse teams