Deltek
Website:
deltek.com
Job details:
Company Summary
As the recognized global standard for project-based businesses, Deltek delivers software and information solutions to help organizations achieve their purpose. Our market leadership stems from the work of our diverse employees who are united by a passion for learning, growing and making a difference. At Deltek, we take immense pride in creating a balanced, values-driven environment, where every employee feels included and empowered to do their best work. Our employees put our core values into action daily, creating a one-of-a-kind culture that has been recognized globally. Thanks to our incredible team, Deltek has been named one of America's Best Midsize Employers by Forbes, a Best Place to Work by Glassdoor, a Top Workplace by The Washington Post and a Best Place to Work in Asia by World HRD Congress. www.deltek.com
Business Summary
The Deltek Engineering and Technology team builds best-in-class solutions to delight customers and meet their business needs. We are laser-focused on software design, development, innovation and quality. Our team of experts has the talent, skills and values to deliver products and services that are easy to use, reliable, sustainable and competitive. If you're looking for a safe environment where ideas are welcome, growth is supported and questions are encouraged – consider joining us as we explore the limitless opportunities of the software industry.
Position Responsibilities
Principal Automation Engineer – AI-Native Quality Engineering
Deltek is seeking a Principal Automation Engineer to help build the quality-engineering foundation for our next-generation, AI-first QMS platform for project-based businesses.
This is not a traditional regression-automation role. You will architect and industrialize Deltek’s in-house AI-native automation platform, combining Playwright with LLM-powered Planner, Generator, and Healer agents. Your work will span intelligent test generation, self-healing automation, AI-output evaluation, and CI/CD quality gates.
Key Responsibilities
- Architect and evolve our Playwright-based, AI-native automation framework.
- Build LLM-powered capabilities for test planning, generation, execution, and self-healing.
- Create end-to-end automation for Projects, Workforce Management, and Financials workflows.
- Implement LLM-as-a-Judge evaluation to score responses, detect hallucinations, and validate outputs against golden datasets.
- Design tests for AI safety, bias, behavioral consistency, prompt injection, and guardrail effectiveness.
- Establish automated release gates for UI, API, data, and AI-model validation.
- Maintain golden datasets and regression baselines for AI drift detection.
- Integrate automation with GitHub Actions or Azure DevOps, ReportPortal, and Grafana.
- Collaborate with Product, AI/ML, Engineering, and QE teams to define quality standards and coverage targets.
- Mentor engineers on Playwright, AI-assisted testing, agentic automation, and framework best practices.
- Support data-migration testing, including schema fidelity and record-level validation.
Required Qualifications
- 8+ years of experience in test automation or quality engineering.
- Strong experience designing automation frameworks used by multiple teams.
- Deep, hands-on expertise in Playwright, including fixtures, API testing, and complex workflow automation.
- Experience testing AI/LLM-enabled applications or building agentic automation solutions.
- Proficiency in TypeScript and/or Python.
- Experience using LLM APIs and tools such as Claude, OpenAI, or GitHub Copilot.
- Strong understanding of AI-quality concepts, including hallucination detection, output scoring, drift, behavioral consistency, and guardrail validation.
- Experience testing REST or GraphQL APIs and validating structured AI-generated responses.
- Strong SQL skills for application, migration, and dataset validation.
- Experience integrating automation into GitHub Actions, Jenkins, or Azure DevOps pipelines.
- Strong communication, technical leadership, mentoring, and cross-functional collaboration skills.
- BS/MS degree in Computer Science, Software Engineering, or a related discipline.
Preferred Qualifications
- Experience with ERP, Quality Management Software, or other enterprise platforms.
- Familiarity with RAG, embeddings, vector databases, and LLM fine-tuning from a testing perspective.
- Experience with self-healing automation, AI security testing, performance testing, or data-drift monitoring.
- Knowledge of ReportPortal, Grafana, phased AI rollouts, shadow-mode testing, and A/B validation.
- Familiarity with AI data privacy and enterprise compliance requirements.
What We Are Looking For
You think in systems, not individual scripts. You proactively identify quality risks, build reusable solutions, and help others adopt them. You can explain complex AI-validation concepts clearly while staying hands-on with architecture and implementation.
Join Deltek and help transform our current AI-driven automation framework into an industry-leading, AI-native quality-engineering platform.
Qualifications
BS/MS degree in Computer Science, Software Engineering, or a related field.
Relevant certifications in software quality, AI/ML, or cloud engineering are advantageous.
Experience:
8+ years of experience in test automation engineering, with at least 3+ years working with AI/LLM-based systems or agentic automation frameworks.
Proven hands-on experience with Playwright — including Playwright agents, fixtures, and API testing integration.
Demonstrated experience using AI tools (Claude API, OpenAI, GitHub Copilot, or equivalent) to accelerate test authoring, framework design, or output evaluation.
Track record of designing and implementing AI-based automation solutions — not just using automation tools, but building the frameworks others use.
Experience integrating automation into CI/CD pipelines (GitHub Actions, Jenkins, or Azure DevOps).
Experience with performance, scalability, or data-drift testing of AI features in production or Quality Management Software contexts.
Career Interests
Engineering
Position Type
FT
Travel Requirements
No
Applicant Privacy Notice
Deltek is committed to the protection and promotion of your privacy. In connection with your application for employment with us at Deltek, it is necessary for us to collect, store and use information about you (“Personal Data”) to administer and evaluate your application. We are the “controller” of the Personal Data you provide us and will process any such Personal Data in accordance with applicable law and the statements contained in this
Candidate Privacy Notice
Additionally, we have not sold and do not sell Personal Data you provide to us through the job application process.
Important: Protect Yourself from Recruitment Scams
Bad actors or scammers may try to impersonate Deltek and send fake job offers to people. Messages from Deltek about employment opportunities will be from an @deltek.com account or Enterprise@trm.brassring.com, never from free services like Gmail or Yahoo. Please look carefully at the email address that provides any job offer, as some fake accounts are created to look like a legitimate domain name or email address. We will also never ask you to pay money at any point in the hiring process, whether for training, equipment, background checks, or anything else. If you receive a suspicious offer claiming to be from Deltek, do not share personal or financial information. Report any suspicious communication to Secure@deltek.com and consider reporting it to law enforcement.
06-Oct-2027
Click on Apply to know more.
