# Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd.
· , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full

Job Description
Freelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on improving AI models through high-quality training data, preference data evaluation, and engineering workflows.
Candidates must be based in Canada.
Role: Python Developer-AI EvaluationExperience: 4+ YearsLocation: CanadaMode of Work: RemoteEngagement: Freelance / Project-BasedMandatory Eligibility CriteriaTechnical Qualification:
• Experience building, maintaining, and improving software pipelines and infrastructure.
• Hands-on experience with preference data collection and/or rubric creation.
• Ability to review technical data and evaluate quality using defined criteria.
• Strong analytical, problem-solving, and technical judgment skills.
• Experience working with large codebases, such as VS Code, is an advantage.
• Ability to explain why a technical solution or output is good, accurate, and effective.
• Strong written and verbal communication skills.
Educational Qualification:
• Bachelor’s or Master’s degree in a relevant field, including BCA, B.
Tech, B.
E., MCA, or M.
Tech.

Experience:
• Candidates from Tier 1 companies are preferred.
• Candidates must not currently be working with Microsoft.
Availability:
• Minimum 4 hours per day and 20 hours per week.
• Minimum 4 hours of overlap with Pacific Standard Time (PST)

working hours
.
• Immediate availability preferred.




• Ability to commit to the full 3-month contract.
Others:
• An updated LinkedIn profile is mandatory for candidate review. Please include the LinkedIn profile URL in your resume.
• Ability to work independently in a fully remote environment.
• Strong attention to detail and commitment to high-quality deliverables.
• Ability to work in a fast-paced environment and deliver results within deadlines.
• Good communication and collaboration skills to work with researchers and engineering teams.
What You’ll Work On
• Design, develop, and improve evaluation rubrics and criteria for preference data.
• Review and label data while ensuring high standards of quality and accuracy.
• Identify subtle issues and inconsistencies in data and evaluation results.
• Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
• Analyze technical findings and prepare transparent reports, summaries, and recommendations.
• Collaborate with researchers and engineers to convert qualitative judgments into scalable processes.
• Support AI training and evaluation workflows to improve the quality of AI model outputs.
• Communicate technical findings clearly and recommend improvements to project teams.
Evaluation Process
• AI Interview
• Technical and Cultural Interview – Approximately 30 minutes.
Perks of Freelancing
• Fully remote work environment.
• Opportunity to work on cutting-edge AI projects with leading AI companies.
• Opportunity to contribute to AI model training, evaluation, and engineering initiatives.
• Competitive hourly compensation based on candidate quality and interview feedback.

📌 Python Developer-AI Evaluation (Winnipeg)
🏢 Linuxassociation
📍 Winnipeg