Compensation: $100–$150/hour, based on interview feedback and candidate quality
Role Overview
We’re looking for experienced software engineers to support cutting-edge AI projects by building data pipelines, refining evaluation criteria, and improving the quality of AI training data.
What You’ll Do
- Design and improve rubrics and evaluation criteria for AI preference data.
- Review and label data while maintaining high quality standards.
- Build and maintain Python or TypeScript-based pipelines and infrastructure.
- Analyze findings and communicate explicit, actionable recommendations.
- Collaborate with AI researchers and engineers to improve evaluation workflows.
Key Requirements
- 5+ years of experience in Python, TypeScript, JavaScript, Golang, Java, or related ML/DevOps engineering.
- Hands-on experience with preference data collection or rubric creation.
- Strong understanding of pipelines, infrastructure, and code quality.
- Excellent analytical, communication, and technical documentation skills.
- Experience with large codebases, such as VS Code, is an advantage.
- Preference for candidates from top-tier companies and universities.
- A LinkedIn profile is mandatory, and candidates must not currently be employed by Microsoft.
Work Commitment
- Minimum 20 hours per week, with at least 4 hours per day.
- Four hours of overlap with Pacific Standard Time (PST).
- Fully remote contractor engagement.
Selection Process
1. AI Interview
2. Coding Challenge
3. 30-minute Technical and Cultural Interview
Interested? Apply now to contribute to advanced AI engineering and evaluation projects with Turing.