This opportunity is for experienced STEM PhDs and technical domain experts to contribute their subject-matter expertise to a cutting-edge AI research and training project with a leading AI laboratory.
You'll use your specialized knowledge to develop challenging, high-quality problems and evaluation content that test the reasoning capabilities of advanced large language models. Your expertise will help shape how AI systems reason through complex technical problems in real-world domains.
No prior AI experience is required — your technical expertise, analytical ability, and problem-solving skills are what matter.
Responsibilities
- Create challenging, realistic technical problems within your area of expertise.
- Apply advanced subject-matter knowledge to develop problems that require deep reasoning and expert judgment.
- Evaluate AI-generated responses for technical accuracy, reasoning quality, and completeness.
- Identify subtle errors, unsupported assumptions, and weaknesses in AI-generated solutions.
- Provide clear, structured feedback to improve AI model performance.
- Develop high-quality reference solutions and evaluation criteria where required.
- Apply rigorous analytical thinking to ensure technical tasks reflect real-world complexity.
- Collaborate with project teams to refine task quality and evaluation standards.
- Communicate complex technical concepts clearly through written and verbal explanations.
Required Qualifications
- PhD, advanced degree, or equivalent industry experience in a relevant technical domain.
- Expertise in one or more of the following areas:
- Medicine / Healthcare
- Statistics & Data Science
- AI / Machine Learning Research
- Computer Science
- Game Development
- Mechanical Engineering
- Aerospace Engineering
- Exceptional attention to detail.
- Strong analytical and problem-solving abilities.
- Excellent written and verbal communication skills.
- Ability to develop complex technical problems and assess solutions objectively.
- Solid ability to work independently in a remote environment.
Preferred Qualifications
- Experience conducting advanced technical research or solving complex domain-specific problems.
- Experience with academic research, technical publications, or industry R&D.;
- Background in developing technical assessments, research problems, benchmarks, or evaluation frameworks.
- Experience reviewing or evaluating complex technical work.
- Familiarity with AI, machine learning, or large language models is a plus, but not required.
- Strong ability to distinguish expert-level reasoning from superficial or generic responses.
- Experience communicating technical concepts to multidisciplinary teams.
Compensation
- Competitive compensation of $55–$80/hour.
- Hourly contract engagement.
- Fully remote.
- Opportunity to contribute to state-of-the-art AI research and training projects.
- Up to 1 hour of onboarding time is paid if hired, including the screening task/interview and onboarding videos.
Eligibility
Currently accepting applicants located in:
- United States
- United Kingdom
- Canada
- Australia (listed in the location requirements, though the posting specifically states U.S., UK, and Canada are currently accepting applicants)
Application Process
1. Apply to the role
2. Complete the short screening interview
3. Complete the technical task (approximately 20–30 minutes)
4. Complete onboarding videos and project orientation
5. Hiring team review
6. Begin contributing technical expertise to AI training and evaluation tasks