Website:
yminds.ai
Job details:
AI Quality Assurance Lead (5+ Years Experience)
YMinds.AI is a premium AI talent network connecting forward-thinking companies with elite, pre-verified AI professionals—including Generative AI Engineers, Data Scientists, and Machine Learning Researchers. We eliminate hiring uncertainty by combining expert human screening with AI-powered interviews and evaluations, ensuring every candidate meets the highest standards of technical excellence, real-world experience, and professional readiness.
Role Overview
We are seeking an experienced AI Quality Assurance Lead to drive quality assurance strategies for AI/ML-driven systems. This role transcends traditional UI/API testing, focusing on validating machine learning models, large language models (LLMs), and data pipelines. You will play a critical role in ensuring the reliability, fairness, and performance of our AI-powered solutions.
Key Responsibilities
- Lead end-to-end QA strategy for AI/ML and data-driven systems.
- Design and implement test frameworks for ML model validation and evaluation.
- Perform LLM testing, including prompt evaluation, response validation, and bias detection.
- Validate data pipelines (ETL) for data quality, consistency, and integrity.
- Build and maintain automation frameworks using Python.
- Define test datasets, benchmarks, and evaluation metrics for AI models.
- Collaborate with data scientists, ML engineers, and product teams to ensure quality standards.
- Identify risks related to model drift, bias, and performance degradation.
- Implement continuous testing practices in CI/CD pipelines.
- Ensure compliance with quality, ethical AI, and governance standards.
Required Skills & Qualifications
- 5+ years of experience in QA, with strong exposure to AI/ML systems.
- Hands-on experience in ML model testing and validation techniques.
- Strong understanding of LLMs and prompt engineering/testing methodologies.
- Experience with data validation and pipeline testing.
- Proficiency in Python for test automation.
- Knowledge of statistical analysis and model evaluation metrics.
- Experience working in Agile/Scrum environments.
Preferred Qualifications
- Experience with tools like Evidently AI, DeepChecks, or similar ML monitoring/testing frameworks.
- Familiarity with MLOps practices and tools.
- Exposure to cloud platforms (AWS, Azure, or GCP).
- Understanding of AI ethics, bias detection, and explainability.
Leadership Expectations
- Mentor QA teams on AI testing practices.
- Drive innovation in AI quality engineering.
- Establish best practices and standards for AI testing.
Soft Skills
- Strong analytical and problem-solving skills.
- Excellent communication and collaboration abilities.
- Detail-oriented with a commitment to quality.
- Ability to work in a fast-paced, dynamic environment.
Educational Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Experience Requirements
- Minimum of 5 years of relevant experience in Quality Assurance, with a focus on AI/ML systems.
Benefits and Perks
- Competitive salary and performance-based bonuses.
- Comprehensive health insurance and wellness programs.
- Opportunities for professional development and continuous learning.
- Flexible work hours and a supportive work environment.
- Access to cutting-edge technology and tools.
Keywords: AI Quality Assurance, ML Testing, LLM Testing, Data Validation, Python Automation, Agile QA, AI Ethics, MLOps
Hashtags: #AI #QualityAssurance #MachineLearning #DataScience #Automation #TechJobs #Bengaluru #YMindsAI
Required Skills
Machine Learning Model Validation: Very Important
Python Automation: Very Important
Quality Assurance: Very Important
Data Validation: Very Important
Agile: Important
MLOps: Important
Statistical Analysis: Important
Model Evaluation and Validation: Important
Test Automation: Very Important
Machine Learning Testing and Validation: Important
Click on Apply to know more.