02 Nov
|
Latitude
|
Canada
Guidepoint is investing in applied AI across its research platform. We are building production AI systems that help research teams interact with our global expert network and proprietary knowledge assets. These systems combine multi-agent workflows, conversational AI, retrieval, and structured data to support reliable, high-quality research experiences. We are looking for a hands-on Senior AI Engineer to take working prototypes into production and shape the architecture as the product grows. You will have broad ownership across agent design, evaluation, APIs, and cloud deployment, working closely with product, engineering, and compliance stakeholders. This is a hybrid role based in our Toronto office. Design and ship systems where specialized agents collaborate to complete research tasks, including task planning, tool use, delegation, handoffs, and result synthesis. Develop production APIs: Build and maintain Python services and APIs that connect agents to Guidepoint products, internal data, and third‑party providers. Ground responses in trusted data: Build retrieval and search pipelines over large internal knowledge assets. Define and maintain evaluations for task success, factual accuracy, groundedness, completeness, policy adherence, latency, and cost. Use representative test sets, regression checks, and production feedback to guide improvements and rollout decisions. Deploy and operate AI services: Own services from design through production deployment and operations, using containers, Kubernetes, Azure, and Databricks where appropriate. Tune the full AI pipeline: Select models and tools, engineer context, define structured outputs, and manage tradeoffs among quality, latency, reliability, and cost.
Establish patterns for code review, testing, observability, incident response, and production readiness as the team grows. 8+ years of software engineering experience, including 3+ years building and operating production AI or LLM‑powered products. ~ A Bachelor’s degree in Computer Science, Engineering, or a related technical field with 6+ years of professional experience; or a Master’s degree with 4+ years of skilled experience in backend software engineering and Generative AI . This must include a proven track record of designing, building, and scaling distributed, production-grade systems. ~ Demonstrated experience designing and shipping multi‑agent or agentic workflows in production, including orchestration, tool use, state management, and failure handling. ~ Strong Python skills and experience building production APIs and backend services. TypeScript experience is useful. ~ Hands‑on experience with cloud‑native deployment, including containers, Kubernetes, CI/CD, and production observability. ~ Experience working with Azure and/or Databricks in production environments. ~ Practical experience with LLM evaluation: creating test sets, measuring quality and accuracy, analyzing failures, and using results to improve systems or gate releases. ~ Experience with retrieval‑augmented generation,
embeddings, vector databases, or large‑scale search systems. ~ Understanding of model and workflow risks, including unsupported answers, prompt injection, unsafe tool calls, and data access boundaries—and experience addressing them through system design and code. ~ Product judgment: you can scope a useful first version, compare approaches with evidence, and ship iteratively. Experience with Databricks, including its data, machine learning, or deployment workflows. Real‑time or streaming systems experience, such as WebSockets, WebRTC, audio pipelines, or other low‑latency services. Voice AI experience, including telephony platforms, speech‑to‑text, text‑to‑speech, turn‑taking, or voice‑agent frameworks. Experience with LLM‑as‑judge methods, human review workflows, or production monitoring for AI quality. Additionally, this position is eligible for an annual discretionary bonus based on performance. Backed by a global network of more than 2 million experts and over 1,600 employees, Guidepoint delivers real‑time access to expertise, primary research, and actionable knowledge that help organizations make informed decisions. Through consultations, surveys, events, proprietary content, and AI‑enabled tools, we support every stage of the decision‑making process—from developing hypotheses and gathering insights to validating assumptions and building conviction for critical decisions. At Guidepoint, our success relies on the diversity of our employees, experts, and clients, which enables us to foster meaningful connections and a broad range of perspectives.
📌 Remote AI Engineer (Canada)
🏢 Latitude
📍 Canada