Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.Key Responsibilities:Build and maintain automated tests for AI workflows and behaviorsTest multi-turn scenarios, scripts, and approval checksCollaborate with engineering to define quality metricsDebug quality issues by tracing requests and logsIdentify risks and document testing processesRequirements:4+ years in QA engineering or similar hands-on rolesStrong skills in Python for production-quality testsExperience with testing LLMs and AI systemsFamiliarity with pytest or similar testing frameworksStrong written communication for documentationUtilize your automation and AI testing expertise to make an impact.

📌 Ai Quality Engineer - Test Automation Expert (Vancouver)
🏢 Centraprise
📍 Vancouver