19 Aug
|
Socket.dev
|
Toronto
19 Aug
Socket.dev
Toronto
Become a Lead Data Scientist in AI Evaluations at RBC, focusing on trusted AI capabilities. Drive methodologies that enhance model quality while working with teams across Canada and globally. As a critical component in RBC’s AI Group, you will leverage over 8 years of data science experience to create and refine evaluation standards. You will guide junior team members, ensuring robust processes for monitoring and validating AI performance.
Your role includes implementing cutting-edge techniques for generative AI and agentic systems. Key Responsibilities:
- Establish and manage evaluation methodologies for AI
- Convert model risk into measurable evaluation standards
- Oversee evaluation datasets and scorecards lifecycle
- Create scalable evaluation methods for complex AI tasks
- Define quality assurance protocols for human evaluations Requirements:
- 8+ years in data science or AI related fields
- Strong foundation in ML evaluation metrics
- Expertise in Python, SQL, and data management
- Proven ability to lead and mentor teams
- Effective communication with diverse stakeholders Your leadership in AI evaluation will support RBC's commitment to trustworthy and responsible AI.
📌 Lead AI Evaluations Data Scientist at RBC (Toronto)
🏢 Socket.dev
📍 Toronto