Principal Technical Product Manager, Evaluations (Winnipeg)

Principal Technical Product Manager, Evaluations (Winnipeg)

17 Nov
|
RBC
|
Winnipeg

17 Nov

RBC

Winnipeg

Job Description
What is the prospect?Deploying AI at scale in Canada’s largest bank is the opportunity of a lifetime. This role focuses on one of the most critical enablers of AI at RBC, connecting deep evaluation of agents’ performance and accuracy with the risk-based governance that allows AI to be enabled for safe use.
Own product strategy for the evaluations and governance capabilities that let the bank build and scale agentic AI responsibly — the layer that assesses AI system quality and safety before and after deployment, and turns those assessments into risk and compliance reporting that business leaders across the bank can act on. This is the single accountable product leader for a capability area that sits at the center of how the bank governs its growing AI footprint, partnering closely with engineering leadership, risk, and compliance stakeholders to keep pace with an area that’s evolving quickly both technically and regulatorily.
What will you do?Product Strategy & RoadmapOwn end-to-end product strategy and a multi-year roadmap for the evaluations and governance capability area, prioritized against business risk, regulatory need, and platform adoptionLead discovery and requirements definition, translating input from engineering, risk, compliance, and business stakeholders into clear product requirementsOwn portfolio-level prioritization and sequencing across the capability area’s roadmap, balancing near‑term regulatory/compliance needs against longer‑term platform investmentEvaluate build‑vs‑buy‑vs‑partner options for evaluation and governance tooling, weighing internal investment against third‑party solutions
Delivery PartnershipPartner with engineering and architecture leadership on feasibility, sequencing, and trade‑offs,



converging on a plan both sides can commit toWork with the project‑management function to convert prioritized requirements into a funded, scheduled program of workStay engaged through delivery, resolving product‑scope questions and re‑planning trade‑offs as they arise
Stakeholder & Business EngagementRepresent the capability area to risk, audit, and compliance stakeholders across the bank’s business linesServe as the primary product voice to senior leadership on the health and trajectory of the capability areaRepresent product considerations within architecture reviews, governance forums, and vendor evaluationsPartner with adjacent product and engineering leaders across the platform so requirements are considered early, not retrofitted later
Launch & Value InputHelp define value messaging and target user personas for the capability area’s launches, in partnership with your peer Principal for go‑to‑marketDefine and track success metrics for the capability area and use them to inform ongoing prioritizationContribute the capability area’s inputs into the broader business case articulating value delivered
People LeadershipBuild, mentor, and lead a team of product managers focused on evaluations and governance, giving them ownership of their individual areasHelp your team apply consistent discovery, prioritization, and delivery practices as they build out their own areasFoster a culture of iterative delivery,



understanding of user needs, and decision‑making backed by data
What do you need to succeed?Must‑have:10+ years of product management experience, including several years focused on risk, compliance, safety, or governance‑oriented technology products or servicesDemonstrated experience delivering production AI/ML systems in an enterprise environment, including hands‑on experience with LLM API integration (e.
G., Anthropic Claude, OpenAI, Azure OpenAI, or equivalent) and direct ownership of how those systems are tested, evaluated, or monitored for quality and riskExperience operating in a regulated industry (e.
G., financial services, healthcare, government) with direct exposure to audit and regulatory review processesStrong technical foundation — able to engage credibly with engineers and architects on system design, API integration patterns (authentication, rate limiting, observability), data pipelines, and vector database/retrieval‑augmented generation (RAG) architecture as it relates to evaluating AI system outputsExcellent communication skills, with proven ability to represent a complex technical and risk‑related agenda credibly to both senior executives and engineering teamsUniversity degree in a technical field (Computer Science, Engineering, or related), or equivalent experience
Nice‑to‑have:Experience leading and developing other product managers, or a track record of stepping into a people‑leadership role from an individual‑contributor/lead‑level product positionDemonstrated experience building products that convert regulatory or audit requirements into automated processes or toolingExperience defining shared interfaces or working agreements between two or m

📌 Principal Technical Product Manager, Evaluations (Winnipeg)
🏢 RBC
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: principal technical product manager, evaluations (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: principal technical product manager, evaluations (winnipeg) / winnipeg