Elevate AI systems with Vector as an Applied Machine Learning Scientist. Focus on agent evaluation, observability, and stress-testing across long-horizon tasks for Canadian organizations.This role entails leading cutting-edge research aimed at enhancing AI agent performance and safety. Working collaboratively with Vector researchers and external partners, you'll develop tailored evaluation methods that move beyond static benchmarks. Key responsibilities include assessing agent trajectories, developing organization-specific evaluations, and creating reliable systems to measure and improve agent effectiveness.Key Responsibilities:Research evaluation methods for long-horizon agentsDevelop comprehensive assessments of agent performanceCreate organization-specific evaluations from production dataConstruct durable regression tests for agent failuresCollaborate with researchers and industry partnersRequirements:PhD in computer science or related fieldExpertise in AI agent evaluation and safetyProficiency in Python and research softwareExperience with modern language modelsStrong analytical skills in experimental designBecome a pivotal resource in enhancing safe AI agents at Vector Institute.#J-18808-Ljbffr

📌 Lead Machine Learning Scientist At Vector (Toronto)
🏢 Vector Institute
📍 Toronto