GiantMind Solutions
Website:
gmindsolution.com
Job details:
🚀 Hiring: AI Quality Analyst (French/German) | Short term contract (2 Months)
📍 India (REMOTE)
🧑💻 Experience: 2 Years
🚫 Availability: 8 hrs/ day (4 hours overlap with PST time zone)
🚫 Language: German (MUST)
Job description:
· Language Proficiency: High-level reading and writing proficiency in the focus language.
· Exceptional Analytical Thinking: Ability to evaluate nuanced AI responses focusing on personalization quality.
· Creative Prompt Engineering: Design multi-turn prompts using personal context.
· Strong Evaluation Acumen: Identify incorrect personalization, poor inferences, and forced connections.
· Attention to Detail: Review Side-by-Side (SxS) model responses.
· Excellent Written Communication: Provide clear, structured rationales.
· Feedback & Collaboration: Provide detailed annotations and work independently.
· Technical Setup: Desktop/Laptop with stable internet connection.
Description:
· Design and execute multi-turn conversational prompts (1–5 turns).
· Evaluate AI responses based on personalization intent.
· Analyze responses for grounding issues and hallucinations.
· Assess integration quality ensuring natural use of personal data.
· Perform SxS model comparison and ranking.
· Write clear evaluation rationales.
· Extract and verify Debug Info from model outputs.
· Maintain strict data hygiene by deleting evaluation conversations.
Skill: Experience in data annotation, AI quality evaluation, content moderation, or a related role is strongly preferred.
Interested, Drop your CV to recruit@giantmindsolutions.com
Click on Apply to know more.