Become part of Dialpad's innovative team as an AI Evaluation Engineer, focusing on the evaluation of Agentic AI systems. Leverage your analytical skills in Vancouver to drive AI success.

As an integral member of the AI Evaluation team, your role will involve developing comprehensive evaluation strategies for our voice and chat solutions. You will build and maintain robust regression evaluations, metrics calibration, and conduct in-depth performance analyses to assure product readiness. Collaboration across various departments will enhance the effectiveness of our AI offerings.

Key Responsibilities:
• Create and implement NLP and speech workflow evaluations
• Conduct rigorous regression tests and A/B analyses




• Co-develop and calibrate evaluation metrics
• Manage data annotation tasks efficiently
• Work with science and engineering teams

Requirements:
• Bachelor's or Master's in Computer Science or similar
• 3+ years in QA, model evaluation, or AI quality assurance
• Experience with structured test strategies
• Robust analytical and communication abilities
• Comfortable collaborating with diverse teams

Utilize your expertise in AI evaluation to make a significant impact at Dialpad.
#J-18808-Ljbffr

📌 AI Evaluation Engineer Role at Dialpad (British Columbia)
🏢 Doist
📍 British Columbia