Crossing Hurdles
Website:
crossinghurdles.com
Job details:
Position: LLM – AI Quality Analyst (Personalization) – Finnish
Type: Short-Term Contract
Location: Remote
Commitment: Part-time (20–40 hours/week, PST overlap required)
Engagement Length: 1 month
Start Date: Immediate
Role Responsibilities
- Evaluate AI-generated responses for personalization quality, grounding, and relevance
- Design multi-turn prompts based on real-world user scenarios and personal context
- Assess AI outputs for accuracy, integration, and overall helpfulness
- Perform side-by-side (SxS) comparisons of model responses and rank effectiveness
- Identify issues such as incorrect personalization, hallucinations, and weak inferences
- Provide clear, structured rationales and detailed feedback on model performance
- Analyze and validate AI behavior using personal data signals and interaction history
- Maintain data hygiene and ensure consistency across evaluation tasks
Requirements
- Strong proficiency in reading and writing Finnish with high comprehension accuracy
- Ability to evaluate nuanced and ambiguous AI responses with strong analytical thinking
- Comfortable using a personal Google account for real-world personalization testing
- Experience in AI evaluation, data annotation, content moderation, or related domains
- Strong prompt design and evaluation skills for multi-turn conversational scenarios
- Excellent written communication with the ability to provide structured feedback
- High attention to detail when reviewing and comparing AI-generated outputs
- Self-driven and capable of working independently in a remote environment
Application Process
- Fill out the application form
- Complete the ICF
- Assessment (Screener + Language Vetting + Required Evaluation Step)
Click on Apply to know more.