Direct message the job poster from Crossing Hurdles.
Base pay range $100.00/hr - $120.00/hr
Position Details Position:
Data Scientist
Referral Partner:
Crossing Hurdles
Type:
Hourly contract
Compensation:
$100-$120 per hour
Location:
Remote
Duration:
3–4 weeks
Commitment:
10‑40 hours/week, flexible and asynchronous
At Crossing Hurdles, we work as a referral partner. We refer candidates to our partner that collaborates with world’s leading AI research labs to build and train cutting‑edge AI models.
Role Responsibilities (Training support will be provided)
Conduct statistical failure analysis across finance‑sector AI tasks.
Identify patterns in AI agent performance failures across task components (e.g., prompts, rubrics, templates).
Perform root cause analysis to determine if failures stem from task design, rubric clarity, or agent limitations.
Analyze performance variations across finance sub‑domains, file types, and task categories.
Create dashboards and reports highlighting failure clusters, edge cases, and areas for improvement.
Recommend improvements to task design, rubric structure, and evaluation criteria.
Communicate insights to data labeling experts and technical teams.
Requirements
Solid foundation in statistical analysis, hypothesis testing, and pattern recognition.
Proficiency in Python (pandas, scipy, matplotlib/seaborn) or R for data analysis.
Experience with exploratory data analysis and deriving actionable insights from complex datasets.
Familiarity with LLM evaluation methods and quality metrics.
Comfortable working with Excel, data visualization tools (Tableau/Looker), and SQL.
Application Process (Takes 20 min)
Upload resume.
AI interview based on your resume (15 min).
Seniority level Mid‑Senior level
Employment type Contract
Job function Research and Information Technology
Industries IT System Data Services
Referrals increase your chances of interviewing at Crossing Hurdles by 2x.