Apply data science and Python expertise to evaluate coding agents through reproducible environments, testing, and rigorous solution verification.

This Competitive Data Scientist role focuses on building reliable tasks and reference solutions for evaluating coding agents. You will prepare relevant data and dependencies, investigate failures, and refine tasks from observed behavior. The work suits candidates with data science, machine learning, quantitative modeling, or research competition experience.

Key Responsibilities:

- Build reproducible environments, data, dependencies, and reference solutions
- Develop tests distinguishing correct and flawed approaches
- Run coding agents against tasks and investigate failures
- Identify implementation errors, assumptions, and data leakage
- Document requirements, reasoning, and verification steps

Requirements:

- Experience in data science, machine learning, or quantitative modeling
- Relevant research competition experience, including Kaggle or DrivenData
- Robust problem-solving ability and methodological understanding
- Programming ability to implement and verify solutions
- Python testing, debugging, and unfamiliar-code experience preferred

Bring analytical judgment, practical programming, and evaluation expertise to strengthen coding-agent task quality and correctness.

📌 Competitive Data Scientist Evaluator (Canada)
🏢 Great Value Hiring
📍 Canada