Lead LawZero's evaluation efforts as Director of AI Evaluations, ensuring trustworthy assessments of advanced AI systems. Shape the future of AI safety and integrity.
As a key hire, you will design the evaluation framework at LawZero, fostering independent assessments that meet the highest credibility standards. You will guide a team in developing benchmarks for the Scientist AI, emphasizing safety and capability measurement. Collaborate closely with research and product teams to ensure accurate evaluations that enhance public trust.
Key Responsibilities:
• Define and implement evaluation strategies for AI systems
• Build a team of experts in machine learning evaluation
• Design benchmarks to apply consistently across AI models




• Oversee the development of datasets and evaluation tools
• Publicly communicate evaluation findings for transparency
Requirements:
• MSc or higher in machine learning, computer science
• 10+ years in ML, including leadership in evaluation
• Expertise in safety evaluations and adversarial techniques
• Proven ability to create evaluation environments from scratch
• Strong ability to convey complex results to diverse audiences
Elevate AI safety through rigorous evaluations and team leadership at LawZero.
#J-18808-Ljbffr

📌 Director of AI Evaluations at LawZero (Montreal)
🏢 LawZero
📍 Montreal