25 Sep
|
Synthires
|
Canada
Senior AI Trainer
Position: Senior AI Trainer
Type: Contractor
Compensation: $14–$36/hour
Location: Remote
About the Opportunity micro1 is seeking Senior AI Trainers to support a customer-driven project focused on improving the quality, reliability, and performance of AI systems through expert-level training and evaluation.
In this role, selected contributors will use their generalist expertise and hands-on familiarity with AI products to evaluate model performance, develop and test prompts, annotate outputs, and provide structured feedback. Your work will help shape how next-generation AI systems learn, reason, and respond across a wide range of real-world scenarios.
Responsibilities
- Evaluate the performance of AI chat and search tools under standardized and repeatable conditions.
- Apply detailed grading guidelines to accurately evaluate, rank, and annotate AI-generated responses.
- Provide structured feedback designed to identify weaknesses and improve model performance.
- Write, refine, and stress-test prompts to assess model capabilities across diverse scenarios, edge cases, and user intents.
- Verify consistency and accuracy across evaluations and correct discrepancies between ratings and established rubrics.
- Use AI training platforms and evaluation tools to record findings and submit evaluation datasets according to project standards.
- Collaborate with project trainers and other contributors to resolve ambiguities and improve evaluation guidelines.
- Participate in ongoing quality reviews and incorporate feedback to maintain rigorous training and annotation standards.
- Maintain accuracy and consistency across assigned evaluation tasks and project milestones.
Required Qualifications
- Exceptional attention to detail and accuracy when reviewing and evaluating AI-generated content.
- Strong written and verbal communication skills for collaboration, reporting, and project updates.
- Strong time-management and self-organization skills for independent work from home.
- Analytical and problem-solving mindset with a proactive approach to resolving evaluation challenges.
- Ability to follow detailed evaluation guidelines and apply grading criteria consistently.
- Comfort working with AI-generated content and structured evaluation workflows.
Preferred Qualifications
- Experience with AI model training, RLHF, data labeling , or similar data-centric evaluation projects.
- Familiarity with AI products, prompt engineering, and common model behaviors and limitations.
- Experience writing evaluation rubrics or grading model outputs.
- Experience reviewing AI responses for accuracy, helpfulness, and safety .
- Background in AI training, machine learning data preparation, or LLM-focused projects .
- Experience using AI annotation, evaluation, or training platforms.
Key Areas of Expertise
- AI Model Evaluation
- AI Training
- LLM Evaluation
- AI Chat & Search Evaluation
- Prompt Engineering
- Prompt Testing
- Data Labeling
- Data Annotation
- RLHF
- Evaluation Rubrics
- Model Response Grading
- AI Quality Assurance
- Model Behavior Analysis
- AI Safety Evaluation
- Structured Feedback
- Quality Control
- Attention to Detail
- Remote Project Management
Compensation & Engagement
- Compensation: $14–$36/hour
- Engagement Type: Contractor
- Work Arrangement: Fully remote
- Location Eligibility: Northern America and Europe
- Project Type: Customer-driven AI training and evaluation
- Work Focus: AI model evaluation, prompt development, annotation, quality review, and structured feedback
- Openings: Approximately 50 positions
Application Process
1. Submit your application with your resume and relevant experience.
2. Demonstrate your ability to evaluate AI-generated content accurately and consistently.
3. Complete any required AI evaluation, annotation, or domain-specific assessment.
4. Complete onboarding and training on the applicable evaluation guidelines and tools.
5. Begin contributing to AI training, evaluation, and quality-assurance workflows.
📌 Data Labeling Specialist (Remote | ) (Canada)
🏢 Synthires
📍 Canada