Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness.
This position is ideal for a Senior, Staff, or Principal-level engineer. You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing clear, opinionated feedback based on your evaluations.
Key Responsibilities: • Evaluate AI-generated coding interactions from start to finish • Assess outputs for usefulness and engineering alignment • Provide critical feedback on quality and reasoning • Distinguish between different levels of response quality • Define what exemplary AI interactions should look like
Requirements: • Senior engineer with relevant experience in AI tools • Proficient in TypeScript, JavaScript, or Python • Familiarity with modern AI-assisted developer workflows • Solid English communication skills (B2 or above) • Comfort giving direct feedback based on evaluations
Bring your engineering expertise and judgment to assess AI interactions effectively.
📌 Remote Senior Software Engineer Evaluator (Winnipeg)
🏢 G2i
📍 Winnipeg