Become a key part of our team as an AI Quality Engineer, focusing on automated test development and quality assurance. This role combines Python expertise with a deep understanding of AI processes.
With a minimum of 4 years in QA or test automation, you'll build and maintain tests for AI agent behaviors and APIs. Proficiency in Python and familiarity with tools like Pydantic Evals are essential. You'll be responsible for validating complex workflows and participating in continuous integration quality checks.
Key Responsibilities:
• Build and maintain automated tests for AI workflows and behaviors
• Test multi-turn scenarios, scripts, and approval checks
• Collaborate with engineering to define quality metrics
• Debug quality issues by tracing requests and logs
• Identify risks and document testing processes
Requirements:
• 4+ years in QA engineering or similar hands-on roles
• Solid skills in Python for production-quality tests
• Experience with testing LLMs and AI systems
• Familiarity with pytest or similar testing frameworks
• Strong written communication for documentation
Utilize your automation and AI testing expertise to make an impact.
#J-18808-Ljbffr

📌 AI Quality Engineer - Test Automation Expert (Vancouver)
🏢 Centraprise
📍 Vancouver