RQ00822 - Senior Systems Testing-QA Specialist

Duration: 2026-12-15 - 2027-06-14

Working Status: Hybrid: 3 days onsite/2 days remote (subject to HM’s discretion)

NOTE: HM is looking for strong AI testing experience.

Must Haves:

- Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms.
- Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.

Nice to Have:

- Public Sector Experience

Qualifications

- The Quality Assurance Specialist (QA lead) is responsible for performing application testing tasks and Quality Assurance activities including Functional Testing, Automation Testing, and various AI testing as described below.
- The Quality Assurance Specialist (QA lead) will participate in planning and estimating the activities required to test the current solutions and enhanced applications. He/She will participate in the development of Master Test Plans, Test
- Cases, Test Scripts, Test Completion Reports, etc. while providing advice to business users for the development of Test Cases for User Acceptance Test.
- Executing the tests as required,



performing issue tracking and resolution.
- The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability, and ensure alignment with business requirements and quality standards.

Key Responsibilities:

- Quality Assurance Leadership
- Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities.
- Assess risks to quality based on verification and validation results and provide recommendations for mitigation.
- Implement and maintain quality processes that support development and production change management.
- Test Design & Planning
- Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.
- Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.
- Collaborate with development leads and business analysts to design and create test data to support test execution.
- Test Execution & Management




- Perform various types of testing manually and/or using automation tools, including:
- Functional Testing
- Regression Testing
- Integration Testing
- Usability/Accessibility Testing
- Performance Testing
- Perform the following types of AI testing activities:
- Functional AI Testing
- Response accuracy
- Hallucination testing
- AI-Security and privacy testing (prompt injection)
- AI-Safety Testing (inappropriate behaviours)
- Execute test cycles, monitor progress, and manage defect resolution and issue tracking.
- Maintain detailed records of test results and discrepancies using designated QA tools.
- Work closely with project managers, implementation team, system administrators, architects, vendors (as needed) and database administrators to ensure testing activities are aligned with project timelines and technical requirements.
- Lead and assist business users in conducting User Acceptance Testing (UAT), providing guidance and support as needed.
- Reporting & Communication
- Manage the full-cycle process for documenting and communicating test discrepancies and defects to appropriate stakeholders.
- Provide regular updates on testing progress, issues, and outcomes to project teams and management
- Develop and build a Test Completion Report summarizing all testing activities and results for Gating purposes

Qualification:

- Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.
- Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.
- Minimum of 3 years of solid experience in AI-assiste

📌 Senior Systems Testing-QA Specialist (Toronto)
🏢 Amyantek
📍 Toronto