Rootly is hiring an AI Quality Engineer to own the evaluation and optimization of its agentic AI features. You will design test scenarios, probe how AI agents reason, and work with engineering to close the loop on performance across incident workflows.
You will partner with product and engineering for new AI releases, define quality metrics, and stay current on evaluation techniques. This role offers a quick-paced, high-impact environment with growth opportunities.