Mercor is partnering with a leading research organization to engage senior management consultants for a structured evaluation project. This role centers on defining and applying rigorous quality standards to real-world consulting work samples not producing deliverables, but setting the benchmark for what excellent looks like.
$150 $220/hr | Flexible | Remote
Key Responsibilities
- Design task-specific grading rubrics for consulting deliverables including market analyses, financial models, strategy recommendations, and executive-ready presentations
- Score completed work samples against established criteria with detailed, evidence-based written justifications for every rating
- Maintain scoring consistency and reproducibility across diverse deliverable types and complexity levels
- Incorporate calibration feedback from senior reviewers and iterate rapidly to align judgment with project standards
- Evaluate structured problem-solving quality across business-case construction, market sizing,
and implementation roadmap development
Core Requirements
- Demonstrable track record in management consulting, with tenure at a top-tier strategy firm (McKinsey, Bain, BCG, or equivalent)
- Deep fluency in financial modeling, business-case development, and quantitative market analysis
- Proven ability to produce rigorous, well-reasoned written assessments under defined evaluation frameworks
- Robust command of slide-based executive communication standards and what separates boardroom-ready work from adequate output
- Comfortable operating under peer calibration having judgment reviewed, benchmarked, and refined against senior standards
Additional Strengths
- Prior involvement in LLM evaluation, human-data annotation, or model training projects
- Experience designing scoring criteria, grading rubrics, or assessment frameworks in a professional or academic context