Drive innovation in AI evaluations as a Lead Data Scientist at RBC. Join a forward-thinking team to enhance AI safety, risk, and performance in a full-time Toronto-based role. In this role, you will be instrumental in defining evaluation standards and methodologies for RBC’s AI systems.

Your robust background in applied machine learning will guide the development of evaluation frameworks, fostering quality and transparency while mentoring junior data scientists in their professional growth. Key Responsibilities:
Develop and implement creative evaluation methodologies for AI
Translate model risks and business needs into measurable criteria
Oversee the management of evaluation datasets from sourcing to improvement




Partner with multiple departments to embed evaluations effectively
Establish rigorous human evaluation and quality assurance processes

Requirements:
8+ years in data science, AI evaluation, or similar fields
Experience with designing evaluation metrics and benchmarks
Practical knowledge of LLM evaluation and quality assessment
Proficiency in Python, SQL, and machine learning practices
Robust stakeholder management and communication skills

Lead RBC’s AI initiatives with robust evaluation practices to ensure high-quality outcomes.

📌 Lead Data Scientist In Ai Evaluations Montreal
🏢 RBC
📍 Montreal