Evaluate cutting-edge AI coding interactions with a remote Senior Software Engineer role. Analyze and judge AI models like OpenAI Codex for their engineering precision and responsiveness.
This position is ideal for a Senior, Staff, or Principal-level engineer. You will leverage your expertise in TypeScript, JavaScript, or Python to determine how well AI coding agents perform in real-world scenarios. Expect a focus on writing transparent, opinionated feedback based on your evaluations.
Key Responsibilities: - Evaluate AI-generated coding interactions from start to finish - Assess outputs for usefulness and engineering alignment - Provide critical feedback on quality and reasoning - Distinguish between different levels of response quality - Define what exemplary AI interactions should look like
Requirements: - Senior engineer with relevant experience in AI tools - Proficient in TypeScript, JavaScript, or Python - Familiarity with contemporary AI-assisted developer workflows - Solid English communication skills (B2 or above) - Comfort giving direct feedback based on evaluations
Bring your engineering expertise and judgment to assess AI interactions effectively.#J-18808-Ljbffr
📌 Remote Senior Software Engineer Evaluator Winnipeg (Canada)
🏢 G2i
📍 Canada