RBC’s AI Group seeks a Senior Data Scientist to excel in AI Evaluations. Lead efforts in model quality, safety, and performance evaluations, collaborating with teams both locally and internationally. In this pivotal role, you will craft and enhance evaluation frameworks, targeting ML and generative AI systems. With over 8 years of experience, you will mentor junior data scientists, ensuring robust methodologies and integration with business needs. Your expertise will guide data sourcing, validation, and quality measures essential to RBC's trusted AI capabilities. Key Responsibilities:
Design advanced evaluation methodologies for AI systems
Define science standards for measurable evaluation criteria
Own lifecycle management for evaluation datasets
Develop scalable generative AI evaluation approaches
Establish reliable human evaluation protocols Requirements:
8+ years in data science or AI evaluation
Advanced skills in ML and generative AI frameworks
Proficiency in LLM evaluation methods
Solid background in Python and SQL
Excellent stakeholder management abilities Bring your expertise in AI evaluation to advance RBC’s mission of building trusted AI. #J-18808-Ljbffr

📌 Senior Data Scientist For Ai Evaluations Quebec City
🏢 Socket.dev
📍 Quebec City