Evaluate AI-generated code with Python or Type Script expertise as an independent contractor supporting Turing’s model improvement work.This experienced software engineering role focuses on reviewing coding agents across real-world repositories. You will assess correctness, robustness, maintainability, and agent behavior, then create evaluation signals that improve coding models. The work includes collaboration with researchers and engineers.Key Responsibilities: Evaluate AI-generated code across real-world software repositoriesReview agent behavior, tool usage, and code changesIdentify technical errors and recurring model failure modesCreate rubrics and evaluation criteria for coding tasksProduce preference data and actionable findingsRequirements: Five or more years of software engineering experienceStrong Python, Type Script, Java Script, Go, or production language proficiencyExperience with substantial real-world codebasesStrong code-review skills and technical judgmentExperience using up-to-date LLMs or AI coding toolsApply software engineering judgment, code review, and written communication to improve Turing’s AI coding models.#J-18808-Ljbffr

📌 Ai Coding Model Evaluation Engineer (Montreal)
🏢 TURING ENTERPRISES
📍 Montreal