Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes. With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs.
Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks. Key Responsibilities:
Build and maintain automated tests for AI workflows and behaviors
Test multi-turn scenarios, scripts, and approval checks
Collaborate with engineering to define quality metrics
Debug quality issues by tracing requests and logs
Identify risks and document testing processes
Requirements:
4+ years in QA engineering or similar hands-on roles
Robust skills in Python for production-quality tests
Experience with testing LLMs and AI systems
Familiarity with pytest or similar testing frameworks
Solid written communication for documentation
Utilize your automation and AI testing expertise to make an impact.
📌 Ai Quality Engineer Test Automation Expert Vancouver
🏢 Centraprise
📍 Vancouver
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.