Lead innovative AI evaluations at Vector Institute as an Applied Machine Learning Scientist. Focus on enhancing agent performance and safety through advanced evaluation methods in Toronto, ON.

This full time role in Toronto, ON, seeks a professional with a PhD in computer science or machine learning. Responsibilities include developing rigorous evaluation systems tailored to Canadian organizations and working collaboratively with the Vector research community. You will design experiments, implement state-of-the-art evaluation methods, and ensure the effectiveness and safety of AI agents.

Key Responsibilities:



• Lead applied research on agent evaluation methods • Develop organization-specific evaluations from various data sources • Create techniques for ongoing evaluation and regression testing • Collaborate with researchers and partners to improve deployment • Build privacy-preserving methods for analyzing agent performance

Requirements: • PhD in a relevant field or equivalent experience • Expertise in AI agent evaluation and automated red-teaming • Strong Python programming skills with research software • Familiarity with machine learning frameworks like PyTorch • Ability to communicate complex research clearly

Contribute to AI agent safety and performance through rigorous evaluation and collaborative research at Vector Institute.

📌 Machine Learning Scientist at Vector Institute (Winnipeg)
🏢 Vector Institute
📍 Winnipeg