Elevate your career as Dialpad's AI Validation Specialist, focusing on validation and performance metrics for agentic solutions. This Vancouver-based role emphasizes collaboration and cutting-edge AI initiatives.
In this position, you will co-own the development and calibration of LLM-judge metrics within our AI Evaluation team. Your tasks will include developing validation strategies, executing rigorous comparisons, and ensuring readiness for product releases via structured testing. Engaging with cross-functional teams will also be crucial to enhance our AI products.
Key Responsibilities:
• Design and execute NLP and speech evaluation workflows
• Improve regression evaluations and conduct A/B testing




• Develop metrics and refine prompts for evaluations
• Handle data annotation job configurations
• Collaborate closely with technical teams
Requirements:
• Bachelor's or Master's in a relevant field
• Minimum of 3 years in quality assurance or related roles
• Proficient in AI-driven product evaluation methodologies
• Robust problem-solving and communication skills
• Experience with cross-functional collaboration
Contribute your skills to shape the future of AI in business communications at Dialpad.
#J-18808-Ljbffr

📌 Dialpad AI Validation Specialist (Vancouver)
🏢 Doist
📍 Vancouver