Hire22.ai
Website:
hire22.ai
Job details:
One of Our client Looking for a skilled and proactive Generative AI Tester with over 5 years of experience in software testing and quality assurance, including 10–15 years focused on Generative AI systems.
The ideal candidate will be responsible for validating AI-driven features, ensuring model reliability, and driving end-to-end testing workflows across enterprise-grade applications.
Key Responsibilities
• Collaborate with produc, and engineering teams to understand AI use cases and define test strategies.
• Design and execute test cases for LLM-based features such as summarization, classification, conversational flows, and content generation.
• Validate model outputs for factual accuracy, tone, relevance, and compliance with domain-specific standards.
• Develop automated test scripts and frameworks for prompt-response validation and regression testing.
• Evaluate ML models using metrics like precision, recall, F1-score, and domain-specific thresholds.
• Conduct integration testing
• Document test results, anomalies, and improvement suggestions in structured formats.
• Ensure ethical AI practices and compliance with data governance policies.
Required Skills & Experience
• 5+ years in software testing, QA, or data validation roles.
• 2–3 years hands-on experience testing Generative AI models (e.g., GPT, LLaMA, Claude).
• Strong proficiency with ML testing tools or frameworks.
• Familiarity with Microsoft Copilot is preferred
• Understanding of ML workflows including time series, regression, classification, and neural networks.
• Excellent communication skills and ability to drive cross-functional discussions with ownership.
Preferred Qualifications
• Experience with prompt engineering and LLM evaluation frameworks.
• Knowledge of ethical AI principles and regulatory compliance (e.g., HIPAA, GDPR).
Click on Apply to know more.