Software Development Engineer in Test – Gen AI / LLM
Role Description
Work Arrangement: 1 day onsite per week
Experience Required: 6–8 years
Key Roles & Responsibilities
Validate chatbot responses for accuracy, relevance, completeness, and consistency.
Create and execute test scenarios, test cases, and regression test suites.
Identify hallucinations, incorrect responses, formatting issues, and knowledge gaps.
Perform chatbot conversation analysis and recommend quality improvements.
Develop and maintain test automation for chatbot validation where possible.
Work closely with developers, AI engineers, and content teams to resolve defects.
Track, document, and report defects, test results, and quality metrics.
Support UAT, release validation, and production quality monitoring.
Key Skillsets
5 years of strong QA SDET test automation experience.
Experience testing AI, LLM, Gen AI, chatbots, virtual assistants, or conversational platforms.




Knowledge of prompt engineering concepts.
Experience with Jira, Confluence, Git Hub, and Agile delivery.
Experience with API testing and automation frameworks.
Strong analytical and troubleshooting skills.
Experience with Python, Selenium, Playwright, Py Test, or similar tools.
Solid communication and documentation skills.
Essential Skills
QA SDET and test automation.
AI, LLM, Gen AI, chatbots, and conversational platforms.
Prompt engineering concepts.
API testing and automation frameworks.
Python, Selenium, Playwright, or Py Test.
Jira, Confluence, Git Hub, and Agile delivery.
Analytical and troubleshooting skills.
Communication and documentation skills.
Desirable Skills
Digital: Python
Digital: Chatbots / Conversational Agents
Generative AI – Quality Engineering

📌 Software development engineer in test – genai (Toronto)
🏢 Astra-North Infoteck Inc. ~ Conquering today’s challenges, achieving tomorrow’s vision!
📍 Toronto