Become part of Dialpad's cutting-edge team as an AI Evaluation Engineer, focusing on the evaluation of Agentic AI systems. Leverage your analytical skills in Vancouver to drive AI success. As an integral member of the AI Evaluation team, your role will involve developing comprehensive evaluation strategies for our voice and chat solutions.

You will build and maintain robust regression evaluations, metrics calibration, and conduct in-depth performance analyses to assure product readiness. Collaboration across various departments will enhance the effectiveness of our AI offerings. Key Responsibilities:
Create and implement NLP and speech workflow evaluations
Conduct rigorous regression tests and A/B analyses
Co-develop and calibrate evaluation metrics
Manage data annotation tasks efficiently
Work with science and engineering teams Requirements:
Bachelor's or Master's in Computer Science or similar
3+ years in QA, model evaluation, or AI quality assurance
Experience with structured test strategies
Solid analytical and communication abilities
Comfortable collaborating with diverse teams Utilize your expertise in AI evaluation to make a significant impact at Dialpad.

📌 Ai Evaluation Engineer Role At Dialpad Vancouver
🏢 Doist
📍 Vancouver