Position: QE / SDET – AI Chatbot & GenAI Validation

Location: Onsite- Toronto, ON

Job type: Full time/Permanent hiring

We are seeking an experienced Quality Engineer (QE) / SDET specializing in AI Chatbot Validation to lead the quality assurance, accuracy testing, and response analysis of our conversational AI platforms [INDEX].

In this role, you will be responsible for evaluating chatbot responses for structural completeness, catching AI hallucination vectors, and executing robust automation regression test suites across APIs and user interfaces [INDEX]. You will work at the intersection of core software testing and advanced prompt engineering to ensure a flawless, reliable user experience.

Key Responsibilities
GenAI & Chatbot Validation: Evaluate and validate conversational AI outputs for contextual accuracy, semantic relevance, formatting bugs, and deep domain knowledge gaps.
Hallucination & Bias Defection: Identify, document, and triage complex AI failures including hallucinations, guardrail bypasses, incorrect logic paths, and inconsistent formatting.
Automation Engineering: Develop, scale, and maintain automated UI and API regression test scripts utilizing contemporary Python automation stacks (e.g.,



Playwright, Selenium, PyTest ).
Conversation Analysis: Perform detailed evaluation of multi-turn user conversation transcripts to recommend fine-tuning adjustments and prompt optimization metrics.
Cross-Functional Collaboration: Partner with prompt engineers, AI developers, product owners, and content curators to isolate root causes of bad responses and track defect resolutions through Agile frameworks.

Required Technical Skill Set
Core QA Foundation:5+ years of formal automated software testing experience (SDET).
AI Ecosystem Experience: Direct background validating LLMs, GenAI models, virtual assistants , or intelligent conversational agents.
Prompt Engineering Awareness: Robust conceptual understanding of prompt optimization, system instructions, and how prompt variations impact chatbot generation logic.
Automation Tooling: Hands-on automation scripting experience using Python combined with PyTest, Playwright, Selenium, or Postman (for API testing).
Agile Ecosystem: Everyday usage of JIRA, Confluence, GitHub, and continuous integration pipelines

📌 Qe / Sdet – Ai Chatbot & Genai Validation Ontario (Canada)
🏢 Ku0026K Global Talent Solutions
📍 Canada