Define AI resolution quality at Asana as a Staff Software Engineer in Vancouver, using evaluation frameworks and production LLM expertise. Work in an office-centric hybrid schedule with standard in-office days Monday, Tuesday, and Thursday.
You will own the technical quality of AI resolution across Asana Service Management. The work spans metrics, retrieval, prompts, knowledge content, agent decisions, Stack AI workflows, and production reliability. You will turn customer experience into engineering priorities with Product, Design, Data Science, and User Research partners.
Key Responsibilities
Define resolution metrics and enforce trusted release gatesDiagnose retrieval, prompt, and knowledge-content failuresSet direction for agent actions, permissions,
and escalationImprove latency and reliability across AI pipelinesWrite, review, and guide production engineering workRequirements:
Eight-plus years of software engineering experienceThree-plus years leading complex cross-team technical workProduction experience shipping LLM or agentic featuresKnowledge of retrieval, search quality, and relevance measurementSystems design judgment and transparent written communicationBring LLM evaluation, retrieval quality, systems design, and technical leadership to Asana Service Management in Vancouver.
📌 Staff Ai Resolution Engineer (Canada)
🏢 Asana
📍 Canada