12 Oct
|
Zodiac Solutions
|
Toronto
12 Oct
Zodiac Solutions
Toronto
Job TitleQuality Engineer (QE) / SDET – AI Chatbot ValidationKey Roles & Responsibilities• Validate chatbot responses for accuracy, relevance, completeness, and consistency.
- Create and execute test scenarios, test cases, and regression test suites.
- Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
- Perform chatbot conversation analysis and recommend quality improvements.
- Develop and maintain test automation for chatbot validation where possible.
- Work closely with developers, AI engineers, and content teams to resolve defects.
- Track, document, and report defects, test results, and quality metrics.
- Support UAT, release validation,
and production quality monitoring.Key Skillsets• 5+ Yrs of strong QA / SDET / Test Automation experience.
- Experience testing AI, LLM, GenAI, chatbots, virtual assistants, or conversational platforms.
- Knowledge of prompt engineering concepts• Experience with Jira, Confluence, GitHub, and Agile delivery.
- Experience with API testing and automation frameworks.
- Strong analytical and troubleshooting skills.
- Experience with Python, Selenium, Playwright, PyTest, or similar tools.
- Solid communication and documentation skills.
validating chatbot responses
📌 Quality Engineer / SDET – AI Chatbot Validation (Toronto)
🏢 Zodiac Solutions
📍 Toronto