Commitment: Part-time, minimum 10–15 hours per week
Role Responsibilities
- Design complex, multi-step Grafana workflows including dashboards, alerting, and data source configurations
- Execute workflows to create reference solutions and validation paths
- Write clear, structured task prompts with measurable outcomes
- Develop programmatic graders to verify task completion
- Review AI-generated attempts, identify failure points, and categorize issues
- Iterate on task design to calibrate difficulty and improve evaluation quality
Requirements
- Strong experience with Grafana in a professional environment
- Strong experience with PromQL, dashboard templating, and alerting systems
- Strong experience configuring data sources such as Prometheus and InfluxDB
- Ability to clearly document workflows for programmatic validation
- Strong experience with Python for writing basic grading scripts
- Solid attention to detail and analytical thinking
- Experience in SRE, platform engineering, or observability-related roles
Application Process (Takes 20 Mins)
- Upload your resume.
- Complete an interview.
- Submit a short form.