Shape AI evaluation standards at LawZero, a non-profit designed for safer AI systems. This leadership role involves creating independent evaluations for the Scientist AI initiative. In this Director of Evaluations role, you will lead and grow a focused team dedicated to rigorous evaluation of AI systems.

You will establish robust evaluation frameworks and ensure that results are credible to the wider AI safety community. Your expertise will enable LawZero to uphold high standards in assessing AI capabilities and safety. Key Responsibilities:

- Define evaluation roadmap and measurement priorities
- Recruit and build the Evaluations Team to 8–10 members
- Design benchmarks for evaluating AI safety and effectiveness
- Oversee datasets and performance measurement environments
- Implement red-teaming initiatives to enhance reliability

Requirements:

- Advanced degree in computer science or related field
- 10+ years of machine learning experience
- Proven leadership in technical team scaling
- Expertise in creating evaluation datasets
- Robust writing and presentation skills for diverse stakeholders

Lead the charge in establishing trust in AI safety evaluations at LawZero.

📌 LawZero Evaluations Director Position (Montreal)
🏢 LawZero
📍 Montreal