Elevate your career as Dialpad's AI Validation Specialist, focusing on validation and performance metrics for agentic solutions. This Vancouver-based role emphasizes collaboration and cutting-edge AI initiatives. In this position, you will co-own the development and calibration of LLM-judge metrics within our AI Evaluation team.

Your tasks will include developing validation strategies, executing rigorous comparisons, and ensuring readiness for product releases via structured testing. Engaging with cross-functional teams will also be crucial to enhance our AI products. Key Responsibilities:

- Design and execute NLP and speech evaluation workflows
- Improve regression evaluations and conduct A/B testing
- Develop metrics and refine prompts for evaluations
- Handle data annotation job configurations
- Collaborate closely with technical teams Requirements:
- Bachelor's or Master's in a relevant field
- Minimum of 3 years in quality assurance or related roles
- Proficient in AI-driven product evaluation methodologies
- Solid problem-solving and communication skills
- Experience with cross-functional collaboration Contribute your skills to shape the future of AI in business communications at Dialpad.

📌 Dialpad AI Validation Specialist (Vancouver)
🏢 Doist
📍 Vancouver