25 Oct
|
Crossing Hurdles
|
Winnipeg
25 Oct
Crossing Hurdles
Winnipeg
Position: Senior Software Engineer Python/Type Script
Type: Contractor Assignment
Compensation: $150/hr
Location: Remote
Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours
Role Responsibilities Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
Design, refine, and iterate on rubrics and evaluation criteria for preference data.
Review and label preference data while identifying subtle quality issues.
Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
Synthesize technical findings into explicit, actionable write-ups, updates, and recommendations.
Requirements Hands-on experience with preference data collection and/or rubric creation.
Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
Experience with AI/LLM evaluation or related engineering workflows is preferred.
A Linked In profile is mandatory for review.
Candidates should not currently be working with Microsoft.
📌 Senior python engineer | $150/hr remote (Winnipeg)
🏢 Crossing Hurdles
📍 Winnipeg