Enhance Rootly's AI capabilities as an AI Quality Engineer focused on rigorous testing and evaluation. Your role will ensure our incident management platform performs flawlessly.As an AI Quality Engineer, you'll bring over 5 years of experience in QA to Rootly, designing test scenarios and evaluating AI features. You'll be responsible for building frameworks, addressing failure modes, and collaborating with product teams to refine current features. This is an chance to leave a significant impact in a high-paced workplace.Key Responsibilities:
Design and conduct tests covering diverse AI inputs
Analyze outputs for accuracy and consistency
Maintain robust test libraries and evaluation standards
Identify unexpected AI behaviors and develop solutions
Collaborate on metrics to assess quality and performanceRequirements:
5+ years of QA or AI evaluation experience
Familiarity with testing LLM-powered products
Capability in prompt engineering and analysis
Strong written communication for all stakeholder levels
Knowledge of evaluation methodologies and frameworksYour expertise in AI will elevate Rootly’s platform and customer satisfaction.#J-18808-Ljbffr

📌 Rootly Ai Quality Engineer Position Toronto (Canada)
🏢 Rootly
📍 Canada