Sirion
Website:
sirion.ai
Job details:
About Sirion
Sirion is the world’s leading AI–native Contract Lifecycle Management (CLM) platform, transforming the end-to-end contracting journey for enterprises. With Agentic AI at the core, the platform’s extraction, conversational search, and AI-enhanced negotiation capabilities have revolutionized contracting across Fortune 500 companies like IBM, Coca-Cola, Citi, and GE. With more than 800 employees across the globe, Sirion comprises a team of AI engineers, legal experts, and researchers who are working relentlessly to build reliable and trustworthy CLM solutions for businesses of tomorrow. Recognized by Gartner, IDC, and Spend Matters as a consistent CLM leader, Sirion continues to set the innovation benchmark for the category.
For more information, visit www.sirion.ai.
Power the Future of AI-Powered Quality Engineering & Why This Role Matters
Join us as a QA Automation Engineer and help shape the future of quality assurance for Sirion’s AI-powered Contract Lifecycle Management platform. In this role, you will be at the forefront of validating both traditional enterprise workflows and next-generation AI-driven capabilities, ensuring reliability, scalability, and exceptional user experiences across our products. You will leverage modern automation frameworks, Agentic AI testing tools, and advanced validation techniques to test complex systems, including Generative AI and Large Language Model (LLM) powered features. Working closely with developers, product managers, data scientists, and engineering teams, you will drive automation excellence, establish robust testing strategies, and ensure the highest standards of software quality. Your contributions will directly impact Sirion’s ability to deliver secure, intelligent, and trusted AI-native solutions to global enterprises.
How You'll Make an Impact
- Deploy Agentic Testing Tools: Lead the adoption of autonomous AI agents within the QA lifecycle to drive intelligent test case generation, automated bug routing, and predictive defect analysis.
- Validate GenAI & LLM Applications: Establish testing frameworks for large language models (LLMs), specifically addressing non-deterministic behaviours, prompt vulnerabilities, hallucination detection, and output consistency.
- Collaborate Across AI Ecosystems: Partner closely with developers, data scientists, and product teams to define evaluation metrics (such as RAG accuracy), validation strategies, and guardrails for AI-driven features.
- Automate UI & API Testing: Build and scale robust automation frameworks using Selenium (Java) with Page Object Models (POM) and REST Assured to validate both core deterministic workflows and AI model endpoints.
- Perform API validation using Postman for exploratory, edge-case, and model response scenarios.
- Design and execute TestNG-based test suites with clear reporting and parallel execution.
- Integrate and execute automation via Maven within CI/CD pipelines.
- Enhance and maintain scalable automation frameworks (UI + API) tailored to handle adaptive, AI-powered system behaviours.
- Create and maintain test cases, test data, and automation scripts for new features, leveraging AI-assisted coding tools to accelerate delivery.
- Debug failures, identify root causes, and log defects in JIRA with clear reproducibility.
- Contribute to framework enhancements that continuously improve automation scalability, efficiency, and runtime intelligence.
Skills & Experience You Bring to the Table
- Experience with Agentic QA & AI Frameworks: Hands-on experience or deep technical familiarity with deploying autonomous AI agents for QA workflows, evaluating RAG (Retrieval-Augmented Generation) pipelines, and validating model outputs.
- Testing Non-Deterministic Systems: Proven track record of designing test strategies for LLM-powered features and managing applications where inputs and outputs are dynamic and shifting.
- 2-5 years of QA automation experience in product-based or fast-paced environments.
- Strong programming skills in Java (OOPs, collections, exception handling). Exposure to Python for AI scripting, model interaction, or data manipulation is highly preferred.
- Bachelor’s degree in computer science, Engineering, or a related field.
- Hands-on experience with Selenium WebDriver (locators, waits, cross-browser testing).
- Solid experience in API automation using REST Assured, including request/response validation, authentication handling, and data-driven testing.
- Experience with TestNG (annotations, grouping, parallel runs, reporting).
- Experience with Maven for build and dependency management.
- Strong understanding of automation framework design (POM, modular architecture, reusable utilities).
- Experience in test case design, defect lifecycle management, and JIRA workflows.
- Good understanding of HTTP protocols, REST APIs, and authentication methods (OAuth, Basic Auth).
- Strong analytical, debugging, and problem-solving skills.
- Effective communication and collaboration abilities.
Commitment to Diversity and Inclusion
We are an equal opportunity employer committed to diversity and inclusion. We do not discriminate based on race, color, gender, religion, national origin, disability, veteran status, or any other protected characteristic. We provide reasonable accommodations as required by law. These principles guide all aspects of employment including recruitment, development, promotions, compensation, and workplace programs.
Click on Apply to know more.
