Lead the Evaluations Team at LawZero, a non-profit focused on protected AI systems. This role centers on building evaluation frameworks and teams for advanced AI like Scientist AI.As the Director of Evaluations, you will shape the evaluation strategies for LawZero's initiatives, focusing on safety and capability assessments. Collaborating closely with research and product teams, your role involves fostering an independent evaluation environment. You'll be pivotal in ensuring that safety claims are credible and trustworthy within both the AI and safety community.Key Responsibilities:Define evaluation strategy and roadmap in collaborationBuild a team of 8–10 over 3–6 monthsDesign novel benchmarks for capability verificationOversee the development of datasets and interactive environmentsLead automated and manual red-teaming programsRequirements:Advanced degree in machine learning or equivalent10+ years in machine learning, 5+ years in leadershipHands-on experience with LLM evaluationStrong background in dataset and benchmark creationExcellent communication skills for diverse audiencesTransform the landscape of AI safety with innovative evaluation protocols and a skilled team at LawZero.

📌 Director Of Evaluations At Lawzero (Montreal)
🏢 LawZero
📍 Montreal