Ideaon
Website:
ideaoninc.com
Job details:
AI Automation Engineer | GenAI | Python | QA Automation | LLM Testing
📍 Bengaluru (Onsite)
🕒 Full-time
💼 Experience: 3–7 Years
We are hiring an AI Automation Engineer to work on next-generation AI-powered applications, intelligent automation systems, and Generative AI platforms.
This role is ideal for engineers with strong experience in automation testing + Python + AI/GenAI exposure, especially around LLM validation, AI workflow testing, and scalable automation frameworks.
⚠️ Only candidates who can join immediately or within 15 days should apply.
What You’ll Work On
- Build and maintain automation frameworks for web, API, and AI-driven applications
- Test and validate LLM/GenAI systems including:
- Prompt workflows
- RAG pipelines
- AI agents
- Response quality & hallucination handling
- Develop automation using Python, Selenium, Playwright, PyTest, etc.
- Perform API testing and backend validation
- Integrate automation into CI/CD pipelines
- Work closely with AI/ML and engineering teams to improve reliability and quality of AI systems
Required Skills
✅ Strong Python programming
✅ Selenium / Playwright / PyTest / Robot Framework
✅ API Testing (Postman, REST APIs)
✅ CI/CD tools (Jenkins, GitHub Actions, Azure DevOps)
✅ Good understanding of QA automation concepts
✅ Pytest
Preferred AI/GenAI Exposure
Experience with any of the following is a strong plus:
- Generative AI / LLMs
- Prompt engineering
- RAG pipelines
- LangChain / LangGraph
- OpenAI / Claude / Llama APIs
- AI model validation/testing
- Vector databases (FAISS, Pinecone, ChromaDB)
- AI-assisted testing frameworks
Good to Have
- AWS / Azure / GCP
- Docker / Kubernetes
- Performance testing (JMeter/k6)
- NLP or ML fundamentals
- Experience testing AI-based products
Who Should Apply?
- Automation Engineers with AI exposure
- SDETs exploring GenAI
- AI QA Engineers
- GenAI Validation Engineers
- Python Automation Engineers interested in AI systems
Click on Apply to know more.