Position: QE / SDET – AI Chatbot & GenAI Validation

Location: Onsite- Toronto, ON

Job type: Full time/Permanent hiring

We are seeking an experienced Quality Engineer (QE) / SDET specializing in AI Chatbot Validation to lead the quality assurance, accuracy testing, and response analysis of our conversational AI platforms [INDEX].

In this role, you will be responsible for evaluating chatbot responses for structural completeness, catching AI hallucination vectors, and executing robust automation regression test suites across APIs and user interfaces [INDEX]. You will work at the intersection of core software testing and advanced prompt engineering to ensure a flawless, reliable user experience.

Key Responsibilities

- GenAI & Chatbot Validation: Evaluate and validate conversational AI outputs for contextual accuracy, semantic relevance, formatting bugs, and deep domain knowledge gaps.
- Hallucination & Bias Defection: Identify, document, and triage complex AI failures including hallucinations, guardrail bypasses, incorrect logic paths, and inconsistent formatting.
- Automation Engineering: Develop, scale, and maintain automated UI and API regression test scripts utilizing modern Python automation stacks (e.g.,



Playwright, Selenium, PyTest ).
- Conversation Analysis: Perform detailed evaluation of multi-turn user conversation transcripts to recommend fine-tuning adjustments and prompt optimization metrics.
- Cross-Functional Collaboration: Partner with prompt engineers, AI developers, product owners, and content curators to isolate root causes of bad responses and track defect resolutions through Agile frameworks.

Required Technical Skill Set

- Core QA Foundation:5+ years of formal automated software testing experience (SDET).
- AI Ecosystem Experience: Direct background validating LLMs, GenAI models, virtual assistants , or intelligent conversational agents.
- Prompt Engineering Awareness: Strong conceptual understanding of prompt optimization, system instructions, and how prompt variations impact chatbot generation logic.
- Automation Tooling: Hands-on automation scripting experience using Python combined with PyTest, Playwright, Selenium, or Postman (for API testing).
- Agile Ecosystem: Everyday usage of JIRA, Confluence, GitHub, and continuous integration pipelines

📌 QE / SDET – AI Chatbot & GenAI Validation (Ontario)
🏢 Ku0026K Global Talent Solutions
📍 Ontario