E-Solutions
Website:
e-solutionsinc.com
Job details:
Role Overview:
We are seeking a highly qualified Politics Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your expertise in politics and political science will help ensure the reliability, consistency, and quality of AI evaluation data across diverse political topics.
Key Responsibilities
- Review and validate domain-specific prompts covering political science, governance, elections, public policy, international relations, political systems, and related topics.
- Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, neutrality, and compliance with project guidelines.
- Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, bias, and low-quality annotations.
- Ensure prompts are challenging, relevant, and aligned with project objectives.
- Provide clear, constructive, and evidence-based feedback to contributors to improve task quality.
- Maintain consistency across reviews by following established quality standards and review guidelines.
- Escalate ambiguous, sensitive, or complex cases when necessary and document review findings.
- Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes.
Minimum Qualifications
- Master's degree or higher in Political Science, Public Policy, International Relations, Government, Public Administration, or a closely related discipline.
- Minimum 3 years of professional, research, teaching, or policy-related experience in the politics domain.
- Prior experience reviewing, evaluating, editing, or quality-checking domain-specific content is preferred.
- Excellent written English communication and analytical skills.
- Strong attention to detail and the ability to identify factual, logical, contextual, and neutrality-related issues.
Preferred Qualifications
- Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality.
- Familiarity with quality assurance, editorial review, or content evaluation workflows.
- Strong understanding of political systems, governance, elections, public policy, international relations, and current political developments.
- Ability to provide objective, impartial, and evidence-based feedback while maintaining consistent quality standards.
- Experience working independently in a fast-paced, quality-focused environment.
Click on Apply to know more.