Senior QA Lead – AI & Automation (10+ Years)

We are looking for a Senior QA Lead with strong expertise in AI-based application testing and API automation to lead quality initiatives across our AI-driven products, including a Meeting Assistant (Agentic AI) and Legal SDL platform. This role will drive QA strategy, ensure high-quality releases, and build scalable automation frameworks.

•           Define and own the overall QA strategy across AI-driven products

•           Lead end-to-end testing for Agentic AI systems (meeting assistant, conversational workflows)

•           Drive API-first automation strategy and ensure high test coverage

•           Validate AI/ML components including prompts, responses, and model behavior

•           Establish test frameworks, CI/CD integration, and quality gates

•           Collaborate with Product, Engineering, and AI teams to ensure testability and quality

•           Manage test planning, execution, reporting, and release sign-offs

•           Mentor QA engineers and build a high-performing QA team

•           Define metrics, dashboards, and quality KPIs

•           10+ years of experience in Software QA / Testing

•           Strong expertise in API Automation (Postman, RestAssured, PyTest, etc.)

•           Hands-on experience in UI Automation (Selenium, Playwright, Cypress)

•           Experience in AI/ML testing (LLMs, chatbots, conversational AI)

•           Understanding of:

o          Prompt validation & response evaluation

o          Hallucination detection

o          Model output validation

•           Strong knowledge of test management practices and tools (JIRA, qTest, TestRail, ADO)

•           Experience in CI/CD pipelines (Jenkins, GitHub Actions, etc.)

•           Strong debugging and root cause analysis skills

•           Experience with Agentic AI systems

•           Exposure to NLP / LLM evaluation frameworks

•           Performance testing of AI systems

•           Knowledge of cloud platforms (AWS/Azure)

•           Ability to own QA delivery across multiple products

•           Strong stakeholder communication

•           Proactive quality ownership and decision-making