Location
montreal
Posted
June 05, 2026
Commute
Local Area
Local Opportunity Near You!
This job is in your area. Enjoy a short commute and work close to home.
Job Description
Lead LawZero's evaluation efforts as Director of AI Evaluations, ensuring trustworthy assessments of advanced AI systems. Shape the future of AI safety and integrity.
As a key hire, you will design the evaluation framework at LawZero, fostering independent assessments that meet the highest credibility standards. You will guide a team in developing benchmarks for the Scientist AI, emphasizing safety and capability measurement. Collaborate closely with research and product teams to ensure accurate evaluations that enhance public trust.
Key Responsibilities:
β’ Define and implement evaluation strategies for AI systems
β’ Build a team of experts in machine learning evaluation
β’ Design benchmarks to apply consistently across AI models
β’ Oversee the development of datasets and evaluation tools
β’ Publicly communicate evaluation findings for transparency
Requirements:
β’ MSc or higher in machine learning, computer science<...
As a key hire, you will design the evaluation framework at LawZero, fostering independent assessments that meet the highest credibility standards. You will guide a team in developing benchmarks for the Scientist AI, emphasizing safety and capability measurement. Collaborate closely with research and product teams to ensure accurate evaluations that enhance public trust.
Key Responsibilities:
β’ Define and implement evaluation strategies for AI systems
β’ Build a team of experts in machine learning evaluation
β’ Design benchmarks to apply consistently across AI models
β’ Oversee the development of datasets and evaluation tools
β’ Publicly communicate evaluation findings for transparency
Requirements:
β’ MSc or higher in machine learning, computer science<...