Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness. This position is ideal for a Senior, Staff, or Principal-level engineer.
You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing clear, opinionated feedback based on your evaluations. Key Responsibilities:
- Evaluate AI-generated coding interactions from start to finish
- Assess outputs for usefulness and engineering alignment
- Provide critical feedback on quality and reasoning
- Distinguish between different levels of response quality
- Define what exemplary AI interactions should look like Requirements:
- Senior engineer with relevant experience in AI tools
- Proficient in TypeScript, JavaScript, or Python
- Familiarity with contemporary AI-assisted developer workflows
- Strong English communication skills (B2 or above)
- Comfort giving direct feedback based on evaluations Bring your engineering expertise and judgment to assess AI interactions effectively.
📌 Remote Senior Software Engineer Evaluator (Montreal)
🏢 G2i
📍 Montreal