GiantMind Solutions
Website:
gmindsolution.com
Job details:
Job description:
Key Qualifications:
· Language Proficiency: High-level reading and writing proficiency in the focus language.· Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses focusing on personalization quality.· Creative Prompt Engineering: Design multi-turn prompts using personal context.· Strong Evaluation Acumen: Identify incorrect personalization, poor inferences, and forced connections.· Attention to Detail: Review Side-by-Side (SxS) model responses.· Excellent Written Communication: Provide clear, structured rationales.· Feedback & Collaboration: Provide detailed annotations and work independently.· Technical Setup: Desktop/Laptop with stable internet connection.
Description:· Design and execute multi-turn conversational prompts (1–5 turns).· Evaluate AI responses based on personalization intent.· Analyze responses for grounding issues and hallucinations.· Assess integration quality ensuring natural use of personal data.· Perform SxS model comparison and ranking.· Write clear evaluation rationales.· Extract and verify Debug Info from model outputs.· Maintain strict data hygiene by deleting evaluation conversations.
Click on Apply to know more.