Lead creative AI evaluations at Vector Institute as an Applied Machine Learning Scientist. Focus on enhancing agent performance and safety through advanced evaluation methods in Toronto, ON.This full-time role in Toronto, ON, seeks a professional with a PhD in computer science or machine learning. Responsibilities include developing rigorous evaluation systems tailored to Canadian organizations and working collaboratively with the Vector research community. You will design experiments, implement state-of-the-art evaluation methods,



and ensure the effectiveness and safety of AI agents.Key Responsibilities:Lead applied research on agent evaluation methodsDevelop organization-specific evaluations from various data sourcesCreate techniques for ongoing evaluation and regression testingCollaborate with researchers and partners to improve deploymentBuild privacy-preserving methods for analyzing agent performanceRequirements:PhD in a relevant field or equivalent experienceExpertise in AI agent evaluation and automated red-teamingStrong Python programming skills with research softwareFamiliarity with machine learning frameworks like PyTorchAbility to communicate complex research clearlyContribute to AI agent safety and performance through rigorous evaluation and collaborative research at Vector Institute.#J-18808-Ljbffr

📌 Machine Learning Scientist At Vector Institute (Ottawa)
🏢 Vector Institute
📍 Ottawa