Apply on Kit Job: kitjob.ca/job/2g99qk

Become integral in refining AI systems as a Remote Java Software Engineer. Focus on evaluating code generation and reasoning capabilities, ensuring excellence in technical outputs.

In this independent contractor role, leverage your software engineering experience to conduct detailed evaluations of LLM-generated code responses. You'll engage in accuracy testing, fact-checking, and annotation work, all while maintaining high evaluation standards. Collaborate with leading AI teams to impact how these systems operate at every complexity level.

Key Responsibilities:



• Evaluate accuracy and reasoning in programming outputs • Conduct thorough fact-checking and testing of code • Provide explicit annotations on model responses for improvement • Ensure AI responses align with expected standards • Apply benchmarks and guidelines in evaluations

Requirements: • Bachelor’s or higher degree in Computer Science • Extensive experience in software engineering disciplines • Expertise in at least one programming language • Proven problem-solving abilities in coding scenarios • Familiarity with working with LLMs in technical roles

Impact the future of AI by enhancing the quality and reliability of coding solutions through your detailed evaluations. #J-18808-Ljbffr

Apply on Kit Job: kitjob.ca/job/2g99qk

📌 Remote Java Software Engineer for AI Systems Evaluation (Toronto)
🏢 YO IT CONSULTING
📍 Toronto