Join LawZero as the Director of Evaluations, focusing on developing safe AI systems. This role emphasizes independent, comprehensive evaluations for the Scientist AI project. As a key member of LawZero’s leadership, you will define state-of-the-art evaluations that will guide both internal and external stakeholders.

Your mission will be to establish independence within the evaluation process and build an adept team to ensure the credibility of AI capabilities measured against industry standards. This is a groundbreaking prospect to influence AI safety. Key Responsibilities:

- Craft LawZero's evaluation strategy and benchmarks
- Build a robust Evaluations Team in first few months
- Independently manage evaluations to mitigate conflicts
- Design new datasets for AI performance metrics
- Lead red-teaming efforts for thorough evaluation

Requirements:

- MSc or higher in machine learning or related discipline
- 10+ years of experience in machine learning
- Leadership experience with real-world ML products
- Background in developing evaluation procedures
- Strong communicator across technical and non-technical audiences

Drive the future of AI safety evaluation with innovative strategies at LawZero.

📌 Director of Evaluations - LawZero (Montreal)
🏢 LawZero
📍 Montreal