Explore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry.In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and quality engineering will be essential as you lead evaluations that prioritize both reliability and effectiveness. Collaborating with various teams, you will strive to enhance the operational integrity of AI solutions.Key Responsibilities:Develop and implement rigorous evaluation scenariosValidate AI performance against defined metricsAssess AI behaviour over multiple releasesDocument and prioritize quality concernsContribute to production-readiness evaluationsRequirements:3-10+ years in related quality engineering rolesStrong knowledge of AI and ML evaluation practicesSolid understanding of software testing frameworksRelevant degree or equivalent experienceProficient in programming with Python or SQLEnsure Zafin's AI solutions earn unwavering trust by validating their performance and reliability in production.#J-18808-Ljbffr

📌 Toronto Ai Evaluation Engineer Opening
🏢 Zafin
📍 Toronto