Principal AI Architect

Remote out of Toronto, Ontario

CAD $200,000 - $220,000 Base Salary THE COMPANY

Our client is a high-growth SaaS technology company at the forefront of applying AI to complex, knowledge-intensive workflows. With a strong investment in agentic AI and next-generation automation, they are building scalable, production-ready systems that transform how organizations interact with content, documents, and enterprise knowledge.

This is a rare opportunity for a seasoned AI architect to define the technical foundations of a rapidly evolving AI platform and have a significant impact on the future direction of the business.

RESPONSIBILITIES

- Lead the design and evolution of the company's agentic AI architecture, establishing standards, patterns, and infrastructure for scalable AI-driven product experiences.
- Build and enhance critical AI infrastructure across evaluation frameworks, testing systems, observability platforms, tracing capabilities, and production agent execution environments.
- Design and implement agent orchestration layers, multi-agent workflows, reasoning engines, memory systems, planning frameworks, and adaptive feedback mechanisms.
- Partner closely with engineering teams to review architecture, identify technical risks, and drive best practices without creating delivery bottlenecks.
- Establish a robust AI quality framework, including evaluation datasets, grading systems, regression testing, release gates, experimentation platforms, and production feedback loops.
- Collaborate with engineering, machine learning, and product leaders to make informed architectural decisions and ensure reliable delivery of advanced AI capabilities.
- Mentor senior engineers through design reviews,



architecture discussions, and technical leadership, raising standards across the wider engineering organization.
- Evaluate emerging advancements in agentic AI and apply them to build scalable, measurable, and impactful solutions.

SKILLS AND EXPERIENCE

Required

- 10+ years of software engineering experience with substantial expertise designing and delivering production AI systems at Staff, Principal, or equivalent level.
- Proven experience building and shipping agentic AI products, including multi-agent systems, LLM orchestration, tool-use frameworks, and agent execution environments.
- Deep expertise in AI evaluation methodologies, including quality rubrics, curated datasets, deterministic and model-based grading, regression testing, and continuous feedback systems.
- Strong experience with advanced Retrieval-Augmented Generation (RAG) and agentic search architectures, including query decomposition, multi-hop retrieval, hybrid search, reranking, metadata filtering, source routing, evidence validation, citations, and confidence scoring.
- Robust understanding of large language models, retrieval systems, and modern agent design patterns.
- Expertise in large-scale systems architecture, cloud-based AI infrastructure, model serving, deployment pipelines, monitoring, and observability.




- Strong Python development skills and hands-on experience with agent frameworks such as LangChain, LangGraph, Microsoft Agent Framework, or similar technologies.
- Demonstrated ability to influence and guide engineering organizations of 15-20+ engineers through architecture and technical leadership.

Preferred

- Experience building agent-based systems within SaaS products focused on content, document management, or enterprise knowledge workflows.
- Experience with cloud-native machine learning infrastructure on AWS or comparable cloud platforms.
- Prior experience operating as a Principal Architect, Distinguished Engineer, or Staff-plus technical leader in a fast-growth technology environment.

BENEFITS

- Competitive base salary of CAD $200,000 - $220,000.
- Opportunity to shape the future of a cutting-edge AI platform.
- High-impact individual contributor role with significant technical ownership.
- Collaborative, innovation-focused engineering culture.
- Flexible hybrid working environment.
- Career growth within a rapidly scaling technology organization.

HOW TO APPLY

Please register your interest by sending your CV via the Apply link on this page.

KEY TERMS

Principal AI Infrastructure Architect | Principal Engineer | AI Architecture | Agentic AI | Multi-Agent Systems | LLMs | RAG | Agent Frameworks | LangChain | LangGraph | Microsoft Agent Framework | AI Infrastructure | AI Evaluation | Observability | Tracing | Model Serving | Python | Distributed Systems | SaaS | Machine Learning Platform | AWS | Enterprise AI | Staff Engineer | Principal Architect | AI Quality Engineering | Knowledge Systems | Retrieval Systems | Orchestration Frameworks

📌 Principal AI Architect (Toronto)
🏢 Harnham
📍 Toronto