Elevate your career as Dialpad's AI Validation Specialist, focusing on validation and performance metrics for agentic solutions. This Vancouver-based role emphasizes collaboration and cutting-edge AI initiatives. In this position, you will co-own the development and calibration of LLM-judge metrics within our AI Evaluation team.

Your tasks will include developing validation strategies, executing rigorous comparisons, and ensuring readiness for product releases via structured testing. Engaging with cross-functional teams will also be crucial to enhance our AI products. Key Responsibilities:
Design and execute NLP and speech evaluation workflows
Improve regression evaluations and conduct A/B testing
Develop metrics and refine prompts for evaluations
Handle data annotation job configurations
Collaborate closely with technical teams Requirements:
Bachelor's or Master's in a relevant field
Minimum of 3 years in quality assurance or related roles
Proficient in AI-driven product evaluation methodologies
Solid problem-solving and communication skills
Experience with cross-functional collaboration Contribute your skills to shape the future of AI in business communications at Dialpad.

📌 Dialpad Ai Validation Specialist Vancouver
🏢 Doist
📍 Vancouver