Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness.
This position is ideal for a Senior, Staff, or Principal-level engineer. You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing clear, opinionated feedback based on your evaluations.
Key Responsibilities:
• Evaluate AI-generated coding interactions from start to finish
• Assess outputs for usefulness and engineering alignment
• Provide critical feedback on quality and reasoning
• Distinguish between different levels of response quality
• Define what exemplary AI interactions should look like
Requirements:
• Senior engineer with relevant experience in AI tools
• Proficient in TypeScript, JavaScript, or Python
• Familiarity with modern AI-assisted developer workflows
• Robust English communication skills (B2 or above)
• Comfort giving direct feedback based on evaluations
Bring your engineering expertise and judgment to assess AI interactions effectively.
#J-18808-Ljbffr
📌 Remote Senior Software Engineer Evaluator (Ontario)
🏢 G2i
📍 Ontario