- Define and execute functional, integration, regression, and end-to-end test strategies
- Develop and maintain automated test coverage across applications, APIs, and workflows
- Support UAT, defect management, release testing, and production readiness
- Test APIs and integrations across internal and external services
- Validate AI-generated outputs for accuracy, relevance, consistency, and grounding
- Assess RAG and retrieval performance
- Establish repeatable evaluation approaches and datasets for AI-enabled functionality
- Investigate, reproduce, and resolve defects with engineering teams
- Provide quality evidence for release and go-live decisions
- Work with engineering, product, and operational teams throughout the development lifecycle
Requirements
- Current SC Clearance required
- Strong experience in QA, Test Engineering, or Test Automation within production applications
- Experience with Playwright, Cypress, or Selenium
- Strong API and integration testing skills using Postman or similar tools
- Experience with SQL, CI/CD, and defect management tooling such as Jira or Azure DevOps
- Good technical understanding of web applications, APIs, and modern application architectures
- Understanding of AI evaluation concepts, including groundedness, relevance, hallucination testing, and retrieval quality
- Strong analytical, problem-solving, and stakeholder communication skills
- Experience testing Generative AI, LLM, or RAG solutions highly desirable
- Python, TypeScript/JavaScript, or similar scripting experience advantageous
Core Competencies
Demonstrates expertise in defining and executing comprehensive testing strategies, including functional, integration, and regression testing, while ensuring high-quality standards for AI-generated outputs and application performance. Proficient in utilizing automation tools and methodologies to enhance testing efficiency and accuracy across various platforms.
Highest-signal resume keywords
- QA Test Engineering
- Test Automation
- API Testing
- Playwright Cypress Selenium
- SC Clearance
ATS Optimization Keywords
Hard Skills
- Test Strategy Development
- Automated Test Coverage
- Defect Management
- SQL
- CI/CD
- Python
- TypeScript
- JavaScript
- AI Evaluation Concepts
- Integration Testing
Soft Skills
- Analytical Skills
- Problem-Solving
- Stakeholder Communication
Certifications & Qualifications
- Current SC Clearance
Industry Keywords
- Generative AI
- LLM
- RAG Solutions
- Web Applications
- Modern Application Architectures
Tools & Technologies
- Postman
- Jira
- Azure DevOps
#J-18808-Ljbffr
Senior QA / Test Engineer - AI & Platform employer: Jobtailor
As a Client Services Coordinator at our dynamic company, you will thrive in a supportive work culture that prioritises employee growth and development. We offer comprehensive training, opportunities for advancement, and a collaborative environment where your contributions are valued. Located in a vibrant area, our team enjoys a healthy work-life balance and the chance to engage with diverse clients, making every day rewarding and meaningful.
