Responsibilities

Evaluate AI-generated coding interactions from end to end.

Judge whether outputs are useful, correct at a high level, and aligned with solid engineering judgment.

Assess the quality of explanations, preambles, reasoning, and generated code.

Distinguish between different levels of response quality and define what makes an interaction excellent.

Provide clear, opinionated written feedback on what worked, failed, or felt misleading.

Help establish quality standards for tools such as Cursor, OpenAI Codex, and Claude Code.

Record short video explanations of evaluation feedback.

Requirements

Senior, Staff, or Principal-level software engineering experience, or equivalent experience.

Strong background in TypeScript/JavaScript or Python.

Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.

Deep familiarity with modern AI-assisted development workflows.





Ability to evaluate code without executing it or reviewing every line.

Strong written and spoken English at B2 level or above.

Comfort giving direct, opinionated feedback and making subjective but rigorous judgments.

High standards for software engineering quality.

Benefits

Remote worldwide contract engagement.

Flexible workload of 10–20 hours per week.

Ongoing projects lasting approximately two weeks to a few months, with new projects available to successful evaluators.

Rate of $100–$200 per hour depending on experience and location.

Start as soon as the take-home evaluation is cleared and a project seat is available.

No interview; selection consists of a take-home evaluation exercise with a recorded Loom walkthrough.

📌 Senior Software Development Engineer - Remote (Canada)
🏢 G2i
📍 Canada