RBC’s AI Group seeks a Senior Data Scientist to excel in AI Evaluations. Lead efforts in model quality, safety, and performance evaluations, collaborating with teams both locally and internationally.

In this pivotal role, you will craft and enhance evaluation frameworks, targeting ML and generative AI systems. With over 8 years of experience, you will mentor junior data scientists, ensuring robust methodologies and integration with business needs. Your expertise will guide data sourcing, validation, and quality measures essential to RBC's trusted AI capabilities.

Key Responsibilities:
• Design advanced evaluation methodologies for AI systems
• Define science standards for measurable evaluation criteria




• Own lifecycle management for evaluation datasets
• Develop scalable generative AI evaluation approaches
• Establish reliable human evaluation protocols

Requirements:
• 8+ years in data science or AI evaluation
• Advanced skills in ML and generative AI frameworks
• Proficiency in LLM evaluation methods
• Robust background in Python and SQL
• Excellent stakeholder management abilities

Bring your expertise in AI evaluation to advance RBC’s mission of building trusted AI.
#J-18808-Ljbffr

📌 Senior Data Scientist for AI Evaluations (Ontario)
🏢 Socket.dev
📍 Ontario