Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India)

MyRemoteTeam, Inc

Website: myremoteteam.com
Job details:

We’re Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India)

We are hiring language experts for AI Query Vetting and Evaluation workflows, contributing to enterprise-level AI systems by ensuring high standards of response quality, factuality, and safety.

Project Details

• Perform AI query vetting on real user inputs
• Evaluate AI-generated responses across:
• Helpfulness & Quality
• Factual Accuracy
• Safety & Sensitivity
• Assign PASS/FAIL decisions with clear justifications
• Conduct Side-by-Side (SxS) evaluations across AI platforms
• Break responses into verifiable claims and validate them
• Detect hallucinations and risk factors
• Maintain structured documentation and evaluation notes

Requirements

• Proficiency in Arabic and English (both written and spoken)
• Master’s degree in Linguistics, Communication, Journalism, Translation, or related fields
• C2-level English proficiency
• 2+ years of experience in AI Evaluation / LLM QA / Query Vetting
• Strong analytical and evaluation capabilities

Work Details

• Location: India (Remote)
• Hours: Up to 35 hours/week
• Must be comfortable with IST hours and overlap with PST/CST

Apply

Send your CV to: sajid.ahmed@truelancer.com

Click on Apply to know more.