Senior Software Engineer – Python / TypeScript | AI Evaluation

Experience:
5+ Years

Job Type
Contractor

Location:
Remote
- Canada Preferred Start Date: Immediate Role Overview We are looking for a Senior Software Engineer with strong expertise in Python, TypeScript, JavaScript, or Golang to support cutting-edge AI evaluation and preference-data projects. The ideal candidate has experience working with large codebases, data pipelines, infrastructure, preference data, and rubric creation, along with strong technical judgment and communication skills.

Key Responsibilities
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label technical data while maintaining a high quality bar.
• Identify subtle quality issues in AI-generated or preference-based datasets.
• Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.



Key Requirements
• 5+ years of professional software engineering experience.
• Strong proficiency in Python, particularly building or maintaining pipelines and infrastructure, OR robust experience with Typescript, Javascript.
• Strong written and verbal communication skills.
• Ability to explain technical decisions clearly and provide actionable feedback.
• Strong judgment when assessing technical quality and identifying subtle issues. Candidate Preferences
• Candidates from Tier-1 technology companies or Tier-1 universities are preferred.
• A valid and updated LinkedIn profile is mandatory and must be included in the resume.
• Candidates currently working with Microsoft are not eligible for this requirement.

📌 Senior Software Engineer (Canada)
🏢 Codefeast
📍 Canada