Rex.zone
Website:
rexmls.com
Company:
https://www.linkedin.com/company/rex-zone
Seniority: Mid-Senior level
Industries: Technology, Information and Internet
Job details:
AI Prompt Engineer Jobs in India (Remote, Full-Time) — Rex.zone
Design, test, and optimize prompts and evaluation workflows that improve LLM performance in real production pipelines. You will collaborate with engineers and researchers to build prompt libraries, run A/B tests, define rubrics, and improve reliability, groundedness, and safety across assistants, copilots, agents, and RAG systems.
Key Responsibilities
- Own prompt lifecycle management: writing, debugging, versioning, and prompt library maintenance
- Design prompt evaluation plans using rubrics for accuracy, completeness, instruction following, tone, and policy compliance
- Create RLHF-style preference/ranking data with clear rationales to support instruction tuning workflows
- Translate product requirements into system prompts, developer prompts, and user prompt patterns
- Improve grounding and reduce hallucinations using RAG strategies and citation/traceability constraints
- Create annotation guidelines and support QA evaluation (edge cases, escalation paths, consistency checks)
- Monitor quality metrics (pass rate, inter-annotator agreement, regression failures) across releases
- Support safety alignment: red-teaming prompts, jailbreak resistance, and sensitive data leakage prevention
Required Qualifications
- 3+ years in software engineering, ML/NLP workflows, or applied LLM prompt engineering
- Strong structured writing for precise instructions and multi-step constraints
- Experience with LLM evaluation: rubrics, pairwise ranking, golden sets, adversarial testing
- Familiarity with RLHF concepts and human feedback loops
- Working knowledge of Python and experimentation tooling (notebooks, scripts, JSON, APIs)
Preferred Qualifications
- Experience with RAG pipelines, vector search, embeddings evaluation, and grounded answer validation
- Knowledge of content safety labeling, policy taxonomy, and prompt-based guardrails
- Experience with LLM observability/eval tooling (regression suites, eval harnesses)
Compensation
Competitive hourly rate:
$30–$50/hr
FAQs
- What does an AI prompt engineer do? They design and optimize prompts, build templates/system instructions, run evaluations and A/B tests, and create feedback data to improve reliability and safety.
- Is this role remote? Yes, this posting is marked Remote and designed for distributed collaboration while targeting candidates based in India.
Click on Apply to know more.
