Enterprise QA Architect

Position Title: Enterprise QA Architect (Data / AI / Apps)

Location: Remote

Duration: 3 Months contract

________________________________________

Position Overview

Our client is building an enterprise-scale AI Health Cloud ecosystem on Microsoft Azure and Databricks platforms. The initiative includes multiple Data and AI-driven software products that require a robust, scalable, secure, and automation-first Enterprise Testing Strategy.

We are seeking an experienced and hands-on Enterprise QA Architect who will take end-to-end ownership of defining, enhancing, governing, and implementing the Enterprise Testing Strategy across all client products and workstreams.

The ideal candidate will possess strong expertise in enterprise quality engineering, test automation, performance engineering, API testing, security testing, data validation, cloud-native platforms, and healthcare-compliant software delivery practices. This role requires both strategic leadership and hands-on technical execution capabilities.

________________________________________

Key Responsibilities

Enterprise QA Strategy & Architecture

Own and drive the End-to-End Enterprise Testing Strategy across all products.

Define enterprise-wide QA standards, frameworks, governance models, and testing best practices.

Establish scalable Quality Engineering processes aligned with Agile, DevOps, and CI/CD methodologies.

Design enterprise testing architecture covering:

o Functional Testing

o Non-Functional Testing

o Security Testing

o Data Validation Testing

o API Testing

o Integration Testing

o Performance Engineering

o Regression Testing

o User Acceptance Testing

o AI Testing

o DR Testing

Define quality gates, release readiness criteria, and test governance processes.

Establish enterprise-wide test metrics, KPIs, dashboards, and reporting mechanisms.

________________________________________

Test Automation Leadership

Lead the implementation of an Automation-First Testing Strategy targeting high automation coverage across products.

Architect scalable automation frameworks for:

o UI Automation

o API Automation

o Data Validation & Reconciliation

o Regression Testing

o Integration Testing

Standardize reusable automation components, libraries, accelerators, and utilities.

Drive shift-left testing practices across development teams.

Collaborate with DevOps Engineers for integration of automated testing into Azure DevOps CI/CD pipelines.

________________________________________

Test Framework & Tooling Ownership

Define and govern the enterprise QA tooling ecosystem.

Implement and manage testing tools including:

o Pytest

o Playwright

o Postman

o JMeter

o Grafana k6

o Azure Test Plans

o Azure Boards

Evaluate and recommend additional testing and observability tools where required.

Establish enterprise test repositories, versioning standards, and framework governance.

________________________________________

Data & AI Platform Testing

Define testing strategies for:

o Azure-based cloud applications

o Databricks workloads

o Data Engineering pipelines

o Data Warehouse migration initiatives

o Semantic Layer implementations

o Power BI reporting ecosystems

o AI/ML-enabled platforms

Lead enterprise data quality validation and reconciliation strategies.

Define validation frameworks for:

o ETL/ELT Pipelines

o Data Integrity

o Data Consistency

o Data Reconciliation

o Business Rule Validation

Collaborate with Data Engineering and AI teams to validate model outputs and data processing workflows.

________________________________________

Security & Compliance Testing

Collaborate with Security Team for Security Testing using enterprise security testing strategy including:

o SAST

o DAST

o SCA

o Penetration Testing

Ensure testing processes comply with healthcare and PHI data security standards.

Establish secure test data management strategies across environments.

Define governance for synthetic, non-production, and production data usage.

Collaborate with security and compliance teams to address vulnerabilities and audit requirements.

________________________________________

Performance Engineering

Architect enterprise performance testing strategy covering:

o Load Testing

o Stress Testing

o Volume Testing

o Scalability Testing

Define performance benchmarks, SLAs, and monitoring frameworks.

Identify system bottlenecks and optimization opportunities across cloud-native platforms.

________________________________________

Environment & Release Management

Define and govern multi-tier testing environments:

o DEV

o INT

o QA

o PROD Parallel

o PROD

Establish environment readiness and deployment validation processes.

Collaborate with DevOps and Infrastructure teams to ensure stable and scalable testing environments.

Drive release quality governance and production readiness assessments.

________________________________________

Stakeholder Collaboration & Leadership

Work closely with:

o Product Owners

o Engineering Teams

o Solution Architects

o Data Engineers

o AI/ML Teams

o Security Teams

o Business Stakeholders

o Client Leadership

Lead QA governance meetings, defect triage sessions, and release reviews.

Mentor QA engineers and establish enterprise QA capability maturity.

Provide strategic recommendations to improve software quality, automation maturity, and delivery efficiency.

________________________________________

Required Skills & Experience

Technical Skills

Mandatory

Strong experience in Enterprise QA Architecture and Quality Engineering.

Hands-on expertise with:

o Playwright

o Pytest

o Postman

o JMeter / Grafana k6

o Azure DevOps

o Azure Test Plans

o Azure Boards

Strong understanding of:

o Test Automation Frameworks

o API Testing

o Integration Testing

o Security Testing

o Performance Testing

Experience testing:

o Cloud-native applications

o Azure services

o Databricks platforms

o Data Engineering pipelines

o Power BI ecosystems

Strong SQL and data validation expertise.

Experience with enterprise test data management and reconciliation frameworks.

Experience with Agile/Scrum delivery models.

________________________________________

Preferred Skills

Experience in Healthcare, PHI, HIPAA, or regulated industry environments.

Exposure to AI/ML system validation and testing.

Experience with large-scale enterprise transformation programs.

Familiarity with observability and monitoring platforms.

Experience building enterprise reusable QA accelerators/frameworks.

________________________________________

Experience Requirements

10+ years of experience in Software Testing / Quality Engineering.

5+ years of experience in QA Architecture or QA Leadership roles.

Proven experience implementing enterprise-scale automation and testing strategies.

Experience leading QA for Data, Cloud, and AI transformation initiatives.

________________________________________

Educational Qualifications

Bachelors or Masters degree in:

o Computer Science

o Information Technology

o Software Engineering

o Data Engineering

o Related discipline

Preferred Certifications:

ISTQB Advanced Level

Azure Certifications

Certified Scrum Master (CSM)

Performance Testing / Security Testing Certifications

________________________________________

Key Success Metrics

Increased automation coverage across enterprise testing landscape.

Reduced defect leakage into production.

Improved release quality and deployment confidence.

Faster testing cycles and reduced regression effort.

Improved security and compliance posture.

Standardized QA governance across all AI Health Cloud products.

Enhanced traceability, reporting, and audit readiness.

________________________________________

Ideal Candidate Profile

The ideal candidate is a strategic QA leader with strong hands-on engineering capabilities who can establish enterprise-grade testing practices for complex Data and AI ecosystems. The individual should be capable of driving both architectural decisions and technical implementation while collaborating effectively with cross-functional global teams.