AI QA Lead

WE ARE HIRING: AI QA Lead



Requirements

• Python Collaborate with business stakeholders to identify and define use cases.
• Design develop and execute automated tests using Python to ensure the functionality and performance of the product.
• Conduct manual testing where necessary to complement automated tests.
• Write simple SQL queries for data extraction and validation.
• Test and validate the product developed by the developers ensuring it meets the specified requirements.
• Understands the basics of GenAI-related tools.
• Basic understanding of LLM evaluation tools (Ragas, DepEval, SAFE,)
• Define and implement testing strategies.
• Exhibit excellent communication and documentation skills to clearly report issues document test cases and articulate the results to technical and non-technical stakeholders.
• Apply analytical skills to troubleshoot and resolve complex problems ensuring the highest quality standards are met.
• Proficient in automating API responses, including handling both authorized and unauthorized scenarios.
• Strong expertise in using Postman and Jenkins.

Skills and Qualifications

• Proficiency in automated testing with Python
• Familiarity with manual testing processes
• Good knowledge of SQL for data manipulation and testing purposes
• Understanding in prompt engineering for LLMs including question generation and evaluation
• Experience with evaluating chatbot use cases and ensuring their effectiveness and relevance
• Exceptional communication and documentation abilities
• Strong analytical and problem-solving skills.

Ready to take your career to new heights? We're InTalent Asia, your go-to recruitment partner in Sri Lanka, and we've got an exciting opportunity for you! Our client is looking for a dynamic individual to fill the role of AI QA Lead

At InTalent Asia, we're not just recruiters; we're here to architect your career success. Join us in the journey of matching your skills with unparalleled opportunities. Apply now and see how you can be the perfect fit for this exclusive position!