GenAI QA Analyst

Location: PCS CHE, Chennai

Years of Experience: 3-6 years

Job Summary: The GenAI QA Analyst is responsible for validating the quality, reliability, and compliance of generative AI solutions within enterprise environments. This role ensures that AI-driven applications deliver accurate, consistent, and business-ready outcomes. Positioned at the intersection of technology and business, the analyst collaborates with product owners, developers, and delivery leads to design and execute QA strategies tailored for AI systems.

Responsibilities:

• Partner with delivery leads and product owners to define QA strategies for generative AI projects.
• Develop and execute test plans to validate AI outputs for accuracy, consistency, and compliance.
• Perform automated and manual testing across diverse business scenarios to ensure reliability of AI models.
• Monitor AI system performance using enterprise-grade tools, proactively identifying and resolving issues.
• Validate integration of AI platforms into enterprise workflows, ensuring seamless adoption and scalability.
• Ensure GitHub Copilot–driven development aligns with QA standards and supports reproducible outcomes.
• Document QA findings in clear, business-readable formats for technical and non-technical stakeholders.
• Promote continuous improvement in AI testing practices and advocate for a quality-first culture across teams.

Mandatory Skills:

• GitHub Copilot (Expert)
• Generative AI Testing Frameworks (Advanced)
• Automated QA Tools & Scripting (Advanced)
• AI Model Validation Techniques (Advanced)
• Performance Monitoring (Dynatrace Davis) (Intermediate)

Preferred Skills:

• AI Foundry
• Microsoft Copilot Studio
• Atlassian Rovo
• Claude Code
• Documentation & Reporting Tools

Qualifications: Bachelor's degree in Computer Science, Engineering, or a related field. 3-6 years of experience in Quality Assurance, with at least 1-2 years in AI/GenAI-focused projects.