22 Nov
|
Jobgether
|
Winnipeg
22 Nov
Jobgether
Winnipeg
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Lead/Senior Research Scientist (Agentic RL) based in Canada.
The Lead/Senior Research Scientist will advance the development of high-performance large language models (LLMs) designed for complex, high-stakes skilled workflows. The role focuses on research and experimentation across agentic reinforcement learning, model training, and model evaluation, with particular emphasis on improving planning, reasoning, tool use, and long-horizon task execution. Working with large open-weight models, the research team applies continual learning, preference optimization, and reinforcement learning to deliver reliable, production-ready AI capabilities. The successful candidate will collaborate closely with research engineers, legal and tax subject matter experts, and product teams to translate research findings into practical model improvements. At Lead level, the position also offers the opportunity to shape the research roadmap, mentor colleagues, and represent the team in the wider machine learning research community.
Accountabilities
Design and develop benchmarks, training datasets, reward models, and training signals that improve model performance across complex professional workflows.
Develop methods for tasks where ground truth is limited, delayed, subjective, or difficult to verify.
Conduct rigorous research experiments and diagnostics, including ablation studies, to distinguish algorithmic improvements from data, reward, and system-related effects.
Translate experimental findings into measurable improvements in production models and model development processes.
Build and expand model evaluation suites to identify strengths, limitations,
and performance gaps across professional use cases.
Use evaluation results to inform training objectives, research priorities, and technical trade-offs.
Research and develop agentic reinforcement learning methods that improve planning, long-context reasoning, tool calling, multi-turn interactions, and long-horizon task execution within real agent environments.
Contribute to post-training approaches, including policy optimization, reward modeling, and the design of reliable training signals for agentic behavior.
Contribute to continued pre-training and post-training of open-weight models, including Direct Preference Optimization (DPO), reinforcement learning, training data design, and strategies for mitigating forgetting through replay.
Develop evaluation methods for complex legal, tax, and other professional workflows, including expert-annotated benchmarks, LLM-as-a-judge systems, evaluation rubrics, and human preference studies.
Work closely with Research Engineers to develop and improve large-scale model training and evaluation infrastructure.
Collaborate with legal, tax, and other professional subject matter experts to ensure model training and evaluation reflect real-world requirements and domain-specific expectations.
Partner with product teams and other model users to understand adoption needs and support the integration of research outcomes into practical applications.
Publish research regularly at leading machine learning and natural language processing conferences and contribute to the broader research community.
At Lead level, define and own a research agenda, translate emerging research methods into a strategic roadmap, and mentor scientists and engineers.
Depending on specialization, contribute primarily to one or two of the following areas: agentic reinforcement learning, model training, or model evaluation.
Requirements:
Education: PhD in Machine Learning, Computer Science, or a related discipline, or equivalent practical research experience.
Research and development experience: Hands-on experience in LLM post-training and/or model evaluation, preferably at the scale of frontier model development.
Technical skills: Solid Python programming skills and practical experience with PyTorch.
Research impact: Demonstrated research contributions through publications at leading venues such as NeurIPS, ICML, ICLR, ACL, EMNLP, or COLM, and/or direct contributions that have influenced an LLM development cycle.
Cross‑functional collaboration: Experience working with researchers, engineers, and subject matter experts to turn research ideas into practical training datasets, evaluation frameworks, or production capabilities.
Communication: Excellent written and verbal communication skills, with the ability to explain complex research findings and collaborate effectively across disciplines.
Adaptability: Comfort working in a fast-paced, evolving research environment where problems may be ambiguous and priorities can change.
Lead‑level requirements: For Lead positions, at least three years of research experience afte
📌 Lead/Senior Research Scientist (Winnipeg)
🏢 Jobgether
📍 Winnipeg