Lead the Evaluations Team at LawZero, a non-profit focused on safe AI systems. This role centers on building evaluation frameworks and teams for advanced AI like Scientist AI. As the Director of Evaluations, you will shape the evaluation strategies for LawZero’s initiatives, focusing on safety and capability assessments.

Collaborating closely with research and product teams, your role involves fostering an independent evaluation environment. You'll be pivotal in ensuring that safety claims are credible and trustworthy within both the AI and safety community. Key Responsibilities:

- Define evaluation strategy and roadmap in collaboration
- Build a team of 8–10 over 3–6 months
- Design novel benchmarks for capability verification
- Oversee the development of datasets and interactive environments
- Lead automated and manual red-teaming programs

Requirements:

- Advanced degree in machine learning or equivalent
- 10+ years in machine learning, 5+ years in leadership
- Hands-on experience with LLM evaluation
- Robust background in dataset and benchmark creation
- Excellent communication skills for diverse audiences

Transform the landscape of AI safety with innovative evaluation protocols and a skilled team at LawZero.

📌 Director of Evaluations at LawZero (Montreal)
🏢 LawZero
📍 Montreal