Evaluate autonomous AI agents remotely using technical feedback, trace debugging, and stress testing for Outlier projects.

This freelance opportunity supports Outlier’s work with leading AI organizations. You will help train large language models to operate as proactive, multi-step agents. The work suits professionals with at least two years of backend engineering, AI automation, or complex systems integration experience.

Key Responsibilities:

- Debug traces from autonomous agent interactions
- Write detailed evaluation rubrics for agent outputs
- Stress test agents against complex workflows
- Identify failures in system behavior
- Support human feedback for AI improvement

Requirements:

- Two or more years of relevant technical experience
- Production-grade software development with modular separation
- Experience with live tools and non-mocked environments
- Transparent, high-density feedback on complex behaviors
- Applicants must reside in eligible listed countries

Bring AI automation, agent evaluation, and technical analysis experience to Outlier’s autonomous systems projects.

📌 AI Automation Agent Evaluator (Toronto)
🏢 Outlier
📍 Toronto