Intellectt Inc
Website:
intellectt.com
Job details:
Job Summary
We are looking for an AI Tester with strong experience in validating AI/ML models, Generative AI applications, and LLM-based systems. The candidate will be responsible for ensuring the accuracy, reliability, safety, and performance of AI-powered products through specialized testing techniques including model validation, prompt testing, and bias detection.
⸻
Key Responsibilities
- Test AI/ML models and Generative AI applications for accuracy, reliability, and performance.
- Validate LLM responses to ensure correctness, relevance, and safety.
- Perform prompt testing and prompt validation for AI chatbots and AI assistants.
- Design and execute test cases for AI models, including edge cases and adversarial inputs.
- Evaluate model hallucinations, bias, toxicity, and fairness issues.
- Conduct data validation testing to ensure training and testing datasets are clean and unbiased.
- Collaborate with AI Engineers, Data Scientists, and platforms.
- Build automated testing frameworks for AI systems.
- Monitor model performance metrics such as accuracy, precision, recall, and F1 score.
- Document test results and provide recommendations for improvements and Product teams to improve model quality.
- Test AI APIs and integrations across applications
Click on Apply to know more.