Explore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry.

In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and quality engineering will be essential as you lead evaluations that prioritize both reliability and effectiveness. Collaborating with various teams, you will strive to enhance the operational integrity of AI solutions.

Key Responsibilities:



• Develop and implement rigorous evaluation scenarios • Validate AI performance against defined metrics • Assess AI behaviour over multiple releases • Document and prioritize quality concerns • Contribute to production-readiness evaluations

Requirements: • 3-10+ years in related quality engineering roles • Robust knowledge of AI and ML evaluation practices • Solid understanding of software testing frameworks • Relevant degree or equivalent experience • Proficient in programming with Python or SQL

Ensure Zafin's AI solutions earn unwavering trust by validating their performance and reliability in production. #J-18808-Ljbffr

📌 Toronto AI Evaluation Engineer Opening (Winnipeg)
🏢 Zafin
📍 Winnipeg