Niveus Solutions
Website:
niveussolutions.com
Job details:
AI Quality Analyst (Advanced / Lead)
Role Summary
Lead AI quality strategy, governance, and evaluation frameworks across Agentic AI systems.
Key Responsibilities
- Define enterprise-wide AI quality standards and benchmarks
- Design scalable evaluation frameworks (offline + online)
- Lead red-teaming, adversarial testing, and safety validation
- Build tooling for continuous evaluation and monitoring
- Partner with architects on guardrails and risk mitigation
- Mentor QA teams on AI-specific testing practices
Must-Have Skills
- 6–10+ years in QA/AI validation
- Deep expertise in LLM evaluation, hallucination detection, and bias testing
- Experience designing quality frameworks for production AI systems
Good to Have
- Regulatory/compliance exposure (especially insurance)
- Experience with observability and AI governance tools
Click on Apply to know more.