Job Description
We are seeking an experienced Senior QA Engineer (AI Native) to join Semios' Engineering team. This position will take ownership of quality throughout the software development lifecycle, from initial requirements and design through testing, deployment, and production monitoring.
The successful candidate will work closely with Product, Engineering, UX, and DevOps teams to establish effective quality gates, improve test automation, and ensure reliable software delivery.
Semios' engineers use AI coding agents to generate code and tests at an accelerated pace. This role focuses on ensuring that AI-assisted development produces reliable, secure, and production-ready software through strong testing strategies, automated quality controls, and evidence-based release decisions.
The immediate focus will be on backend API testing, contract testing, integrations, webhooks, and implementing AI-enabled QA practices within the engineering team's workflows.
Responsibilities
API Testing & Automation
- Design, develop, and maintain automated testing frameworks for public-facing APIs, backend services, and integrations.
- Perform API contract testing, ideally using Pact, to validate compatibility between services.
- Test integrations, webhooks, data exchanges, and end-to-end backend workflows.
- Ensure API reliability, performance, security, and data integrity.
- Support the modernization of existing integrations and development of new public-facing APIs.
- Build and maintain automated API, integration, and end-to-end test suites.
AI-Driven Testing & Quality Gates
- Define, implement, and continuously improve automated quality gates throughout the SDLC.
- Leverage AI coding agents such as Claude Code and GitHub Copilot to generate, execute, and maintain automated tests.
- Develop agent-driven workflows for test generation, failure triage, security testing, and reporting.
- Review AI-generated tests to identify weak assertions, incorrect assumptions, false positives, and inadequate coverage.
- Establish testing standards and agent instructions that developers can incorporate into their daily workflows.
- Determine which tests should run before code merges, during CI/CD, before release, and in production.
- Ensure automated testing remains reliable, efficient, and scalable as development velocity increases.
Production Quality, Monitoring & Security
- Implement testing and monitoring strategies for production APIs and integrations.
- Work with Engineering and DevOps to support continuous deployment, feature flags, staged rollouts, and rollback strategies.
- Define monitoring, alerting, and observability requirements for critical services.
- Identify and troubleshoot production defects, integration failures, and API performance issues.
- Apply appropriate security and data protection practices, particularly when testing APIs handling financial or sensitive information.
- Track quality metrics including escaped defects, change failure rates, and time to detect and resolve incidents.
Quality Strategy & Collaboration
- Own and continuously improve the overall testing strategy across the SDLC.
- Participate early in requirements reviews, architecture discussions, and solution design.
- Ensure requirements and acceptance criteria are clear, testable, and suitable for AI-assisted development.
- Conduct risk-based exploratory testing for complex workflows and high-impact changes.
- Collaborate with developers, Product Managers, UX, and Platform teams to establish quality standards.
- Mentor junior QA engineers and developers on modern testing practices and AI-assisted quality engineering.
- Communicate testing results, quality risks, and release readiness to technical and non-technical stakeholders.
- Support effective asynchronous collaboration across geographically distributed teams.
Qualifications
Required Experience & Skills:
- 5+ years of experience in Quality Engineering, QA Automation, SDET, or similar roles.
- Strong hands-on experience with API testing, automation, and backend integration testing.
- Experience with API contract testing, ideally using Pact.
- Experience testing webhooks, service integrations, and distributed systems.
- Practical experience using AI coding agents such as Claude Code, GitHub Copilot, or equivalent tools.
- Demonstrated experience implementing AI-assisted testing workflows and automated quality gates.
- Experience developing and maintaining automated tests using TypeScript or similar programming languages.
- Experience with Playwright or comparable automated testing frameworks.
- Strong understanding of CI/CD pipelines and continuous delivery practices.
- Experience with production monitoring, observability, and alerting.
- Understanding of API security, sensitive data handling, and testing systems that process financial information.
- Experience defining test strategies, quality standards, and release criteria.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication skills and ability to work independently in a remote environment.
Preferred Experience
- Hands-on Pact contract testing experience.
- Experience with Playwright and its AI agent integrations.
- Experience using Claude Code to automate QA workflows.
- Familiarity with Buildkite, GitHub Actions, or similar CI/CD tools.
- Experience with Datadog or comparable observability platforms.
- Experience with Jira, Git, and GitHub.
- Knowledge of security, performance, fuzz, and accessibility testing.
- Experience implementing feature flags, canary deployments, and automated rollback processes.
- Previous experience working with public-facing APIs and financial data.
- Experience supporting teams adopting AI-native or agentic software development practices.
Affinity Earn
Know someone who’s great for this, or any of our open roles? Earn up to $4,000/year for each successful referral through Affinity Earn. You can also earn up to $50,000 for helping us find new clients. Learn about our referral program at https://affinity-group.ca/earn/ or browse our jobs & follow us at https://www.linkedin.com/company/affinity-staffing/jobs/
About Affinity
Affinity Group is a technology and business consulting and services company. We believe in creating long term relationships between clients and consultants that foster a mutually beneficial partnership. Affinity is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All employment is decided on the basis of qualifications, merit and business need.
For more information on Affinity, please visit www.affinity-group.ca
Job Number: 14164
