Lead the charge in AI evaluation as a Senior Data Scientist for RBC's AI Group. You will facilitate trusted AI capabilities through cutting-edge evaluation methodologies and technical mentorship. As a Staff Data Scientist specializing in AI Evaluations, you will take on a senior role in shaping how RBC evaluates model quality and performance.

You will design and improve evaluation datasets, quality benchmarks, and methodologies that will transition AI systems into reliable production. Your work will involve collaborating with multiple teams to ensure comprehensive evaluation integration throughout the AI development lifecycle. Key Responsibilities:
Drive advanced evaluation methodologies including datasets and rubrics
Define measurable criteria for model risk and product quality




Own lifecycle processes for evaluation datasets and scorecards
Partner with teams to embed evaluations into release workflows
Establish protocols for human evaluation and data quality Requirements:
8+ years in data science or AI evaluation
Robust experience with evaluation frameworks for ML and AI systems
Practical knowledge of LLM evaluation methods
Proficiency in Python, SQL, and AI/ML practices
Excellent communication and stakeholder management skills Enhance RBC's AI capabilities through your expertise in model evaluation and mentorship while driving forward the field of responsible AI.

📌 Senior Data Scientist Ai Evaluations At Rbc Montreal
🏢 RBC
📍 Montreal