Role Summary

The Test Lead is responsible for defining the test strategy and leading automation execution for AI-enabled applications. The role provides technical leadership and ensures consistent quality across UI, API, and data layers.

Key Responsibilities

• Define an automation-first, end-to-end test strategy covering AI agents, orchestration layers, backend APIs, and UI applications.
• Lead and govern Selenium and/or Playwright-based automation frameworks across multi-agent workflows, APIs, and portals.
• Provide technical guidance and conduct code reviews for Java- and Python-based automation implementations.
• Oversee testing across AI agents and services supporting end-to-end automated and analytical workflows.
• Review and guide AI testing coverage, including prompt testing, guardrail validation, response accuracy, and reasoning checks.
• Ensure adequate test coverage for the System Under Test (SUT).
• Lead regression planning, defect triage, root cause analysis (RCA), reporting, and release sign-offs.
• Mentor test engineers and ensure consistent QA standards, best practices, and automation quality.

Requirements

Required Skills (Must Have)

• Strong automation development experience
• Proficiency in Java or Python
• Expertise in Selenium and/or Playwright frameworks
• Experience in API automation and SQL-based data validation
• Hands-on knowledge of at least one AI testing tool (e.g., Testsigma, Testim, Mabl, or Functionize)
• Understanding of cloud-based platforms (e.g., Microsoft Azure)
• Minimum of 2 years of hands-on experience testing GenAI and Agentic AI solutions across production, client-facing, or enterprise systems, including involvement in test coordination and review activities

Good to Have

• ERP / Accounts Payable knowledge (e.g., Oracle ERP, SAP)
• ISTQB certification