Job Title: Quality Engineer – AI Chatbot Validation

Location: Toronto, ON

Work Arrangement: 1 Day onsite

Employment Type: Contract

Duration: 12+ Months

Domain: BFSI

Pay Rate: CAD 40-45/hr on Incorporated

Application Deadline: Oct 30th, 2026

SKILLS REQUIRED

- 5+ years of experience in Quality Engineering, QA, Software Testing, Test Automation, or Software Development.
- Strong programming skills in Java, Python, Groovy, or equivalent languages, with 5+ years of hands-on experience.
- Experience validating AI/ML applications, GenAI solutions, LLMs, chatbots, conversational AI, and AI-powered APIs.
- Strong hands-on experience with Selenium, Playwright, Cucumber/Gherkin, RestAssured, or comparable automation tools.
- Experience testing APIs, microservices, databases, system integrations, functional/non-functional requirements, and regression testing.
- Proficiency with JUnit, TestNG, qTest, ReadyAPI,



and JMeter.
- Strong understanding of TDD, BDD, ATDD, Continuous Testing, and Risk-Based Testing practices.
- Experience evaluating AI outputs for accuracy, relevance, grounding, hallucinations, bias, toxicity, consistency, and prompt effectiveness.
- Ability to develop AI evaluation datasets, test scenarios, test data, and automated validation strategies for GenAI applications.

EEOC Compliance

We are an equal prospect employer, and all qualified applicants will receive consideration for employment.

DISCLAIMER

AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.

📌 Quality Engineer – AI Chatbot Validation (Toronto)
🏢 Pacer Group
📍 Toronto