Lead Data QA Automation Engineer

Lead Data QA Automation Engineer

Location: Chennai, Bangalore, Pune, Hyderabad (or nearby HCLTech office)

Experience: 68 Years

Shift Timing: 2 PM 10 PM IST

Work Mode: Hybrid 3 days/week from nearest HCLTech office

Role Overview:

We are looking for an experienced Lead Data QA Automation Engineer with strong expertise in Databricks, Python, and data quality automation. The ideal candidate should have hands-on experience in testing data pipelines, validating data quality, and building automation frameworks in modern data platforms.

Key Skills Required:

• Strong experience with Databricks and Microsoft Fabric
• Hands-on experience in Python and Pytest framework
• Experience in Databricks Lakehouse monitoring and data pipeline testing
• Experience with Data Observability tools
• Strong knowledge of Data Quality automation tools (Great Expectations, TensorFlow Data Validation)
• Experience with CI/CD integration and parametrized testing
• Experience working with Azure cloud platform
• Familiarity with Databricks Genie and GitHub Copilot (nice to have)

Key Responsibilities:

• Develop and maintain automation frameworks for data validation and pipeline testing
• Monitor data pipelines and ensure data quality and reliability
• Work with analytics and engineering teams to validate data workflows
• Integrate automation scripts with CI/CD pipelines
• Ensure scalability and performance of data testing processes