Applied AI evaluation and user-centred research define this full time contract role with Kids Help Phone in Toronto, using qualitative and quantitative methods.

As an Applied AI Evaluation & Product Researcher, you will evaluate a youth-facing generative AI product. You will develop measurement strategies, conduct UX research, assess risks, and translate evidence into recommendations. The hybrid contract requires working one or two days weekly in the workplace.

Key Responsibilities

Develop evaluation strategies from early testing through post-launch monitoring

Create evaluation matrices linking objectives, indicators, data, and decisions

Conduct surveys, usability testing, journey mapping, and co-design activities

Assess unintended outcomes, bias, safety, privacy, and equity risks





Synthesize findings into recommendations, reports, briefings, and decision materials

Requirements

PhD or equivalent Master’s experience in a related discipline

Minimum five years evaluating generative AI or digital services

Knowledge of responsible AI, safety, risk, or technology governance

Strong qualitative and quantitative research experience

Experience translating findings into product or implementation recommendations

Bring evaluation strategy, UX research, and responsible AI expertise to Kids Help Phone’s youth-focused generative AI initiative.

📌 Applied AI Evaluation Researcher (Winnipeg)
🏢 Kids Help Phone
📍 Winnipeg