08 Nov
|
Manulife
|
Toronto
This is a high-visibility, high-impact role suitable for experienced data scientists who also have strong communications ability and business awareness, as well as the ability to make judgment calls in ambiguous situations. You will support Global AI Model Validation and Governance’s mandate of identifying, assessing, and communicating AI/ML model risks across all AI/ML models deployed across Manulife globally. You will provide thoughtful independent challenge ot models, weighing the risks and benefits and explaining your conclusions to technical and non-technical audiences alike. You will interact heavily with model developers, business stakeholders, and other risk management teams, each potentially offering contrasting perspectives that you will have to navigate and align simultaneously. You will also be expected to use your data science experience to mentor and guide junior members of the team. Position Responsibilities
- Provide independent challenge and constructive feedback for AI/ML, GenAI, and agentic models by identifying model weaknesses, limitations, assumptions, and risks, and recommending appropriate remediation actions.
- Manage competing deadlines, competing expectations, and coordinate procedural alignment to ensure the balance of risk management activities is commensurate with the business risk exposure.
- Communicate complex technical concepts and validation findings to technical and non-technical stakeholders, while ensuring that the risk management process is followed.
- Review model documentation, assess model design and performance, and communicate validation findings through clear, evidence-based reports and recommendations.
- Conduct model testing, benchmarking, sensitivity analysis, and other validation activities.
- When appropriate, evaluate whether AI models are reliable, fair, safe,
explainable, and fit for its intended purpose.
- Support model inventory management, model risk operations and other AI governance processes.
- Mentor and support junior data scientists through technical coaching, knowledge sharing, and review of validation approaches and methodologies. Required Qualifications
- Master's degree or higher in Statistics, Biostatistics, Data Science, Engineering, Mathematics, or a related quantitative field.
- At least 3-5 years of a mix of hands-on data science experience (data science, statistics, AI/ML model development, AI/ML research, model validation, model risk management, or a related quantitative discipline) and a stakeholder-exposed role (functions that interact with varying teams and business units across the organization.)
- Strong critical thinking skills and the ability to independently challenge assumptions and assess model risk in the context of the business problem it solves.
- Hands-on keyboard report writing and code implementation; being able to implement your ideas yourself.
- Experience interpreting model performance metrics and conducting quantitative analyses in a variety of standard and non-standard contexts.
- Strong communication, written documentation, and stakeholder management skills.
- The ability to collaborate with parties from all walks of a large corporation. Preferred Qualifications
- Prior model validation experience for AI/ML models or development of AI/ML models for production environments with tangible risk exposures. Comparable experience includes model development in stringently risk-controlled contexts such as pharmaceuticals, aerospace, etc.
- Knowledge of AI governance and model risk regulatory expectations, with emphasis on OSFI E-23.
- Familiarity with Responsible AI concepts, including fairness, explainability, robustness, transparency, safety, and monitoring. Being passionate about Responsible AI is a plus.
- Experience evaluating Generative AI, LLMs, RAG systems, or agentic AI solutions built or customized to solve a very broad range of business problems.
- Experience developing validation frameworks, testing libraries, or automated assurance tooling.
- Experience working in a global, cross-functional workplace.
- Experience performing research on AI/ML models in academic or industry settings. When you join our team
- We’ll empower you to learn and grow the career you want.
- We’ll recognize and support you in a flexible environment where well-being and inclusion are more than just words.
- As part of our global team, we’ll support you in shaping the future you want to see. #LI-Hybrid The role being advertised is an existing vacancy. About Manulife and John Hancock Manulife Financial Corporation is a leading international financial services provider, helping people make their decisions easier and lives better. To learn more
about us
, visit https://www.manulife.com/en/about/our-story.html. Manulife is an Equal Opportunity Employer At Manulife/John Hancock, we embrace our diversity. We strive to attract, develop and retain a workforce that is as diverse as the customers we serve and to
📌 Senior Manager AI Model Validation (Toronto)
🏢 Manulife
📍 Toronto