MyRemoteTeam, Inc
Website:
myremoteteam.com
Job details:
We’re Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India)
We are hiring language experts for AI Query Vetting and Evaluation workflows, contributing to enterprise-level AI systems by ensuring high standards of response quality, factuality, and safety.
Project Details
- Perform AI query vetting on real user inputs
- Evaluate AI-generated responses across:
- Helpfulness & Quality
- Factual Accuracy
- Safety & Sensitivity
- Assign PASS/FAIL decisions with clear justifications
- Conduct Side-by-Side (SxS) evaluations across AI platforms
- Break responses into verifiable claims and validate them
- Detect hallucinations and risk factors
- Maintain structured documentation and evaluation notes
Requirements
- Proficiency in Arabic and English (both written and spoken)
- Master’s degree in Linguistics, Communication, Journalism, Translation, or related fields
- C2-level English proficiency
- 2+ years of experience in AI Evaluation / LLM QA / Query Vetting
- Strong analytical and evaluation capabilities
Work Details
- Location: India (Remote)
- Hours: Up to 35 hours/week
- Must be comfortable with IST hours and overlap with PST/CST
Click on Apply to know more.