Senior Software Engineer – Python / TypeScript | AI Evaluation

Experience: 5+ Years

Job Type: Contractor

Location: Remote - Canada Preferred

Start Date: Immediate

Role Overview

We are looking for a Senior Software Engineer with robust expertise in Python, TypeScript, JavaScript, or Golang to support cutting-edge AI evaluation and preference-data projects.

The ideal candidate has experience working with large codebases, data pipelines, infrastructure, preference data, and rubric creation, along with strong technical judgment and communication skills.

Key Responsibilities

- Design, refine, and iterate on rubrics and evaluation criteria for preference data.
- Review and label technical data while maintaining a high quality bar.
- Identify subtle quality issues in AI-generated or preference-based datasets.
- Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.





Key Requirements

- 5+ years of professional software engineering experience.
- Strong proficiency in Python, particularly building or maintaining pipelines and infrastructure, OR strong experience with Typescript, Javascript.
- Strong written and verbal communication skills.
- Ability to explain technical decisions clearly and provide actionable feedback.
- Strong judgment when assessing technical quality and identifying subtle issues.

Candidate Preferences

- Candidates from Tier-1 technology companies or Tier-1 universities are preferred.
- A valid and updated LinkedIn profile is mandatory and must be included in the resume.
- Candidates currently working with Microsoft are not eligible for this requirement.

📌 Senior Software Engineer | $100-$150/hr (Canada)
🏢 Codefeast
📍 Canada