Flag job

Report

Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India)

Location

India

JobType

part-time

About the job

Info This job is sourced from a job board

About the role

MyRemoteTeam, Inc

Website: myremoteteam.com
Job details:

We’re Hiring: Arabic + English Language Experts for AI Evaluation (Remote | India)

We are hiring language experts for AI Query Vetting and Evaluation workflows, contributing to enterprise-level AI systems by ensuring high standards of response quality, factuality, and safety.


Project Details

  • Perform AI query vetting on real user inputs
  • Evaluate AI-generated responses across:
  • Helpfulness & Quality
  • Factual Accuracy
  • Safety & Sensitivity
  • Assign PASS/FAIL decisions with clear justifications
  • Conduct Side-by-Side (SxS) evaluations across AI platforms
  • Break responses into verifiable claims and validate them
  • Detect hallucinations and risk factors
  • Maintain structured documentation and evaluation notes


Requirements

  • Proficiency in Arabic and English (both written and spoken)
  • Master’s degree in Linguistics, Communication, Journalism, Translation, or related fields
  • C2-level English proficiency
  • 2+ years of experience in AI Evaluation / LLM QA / Query Vetting
  • Strong analytical and evaluation capabilities


Work Details

  • Location: India (Remote)
  • Hours: Up to 35 hours/week
  • Must be comfortable with IST hours and overlap with PST/CST


Apply

Send your CV to: sajid.ahmed@truelancer.com

Click on Apply to know more.