Job DescriptionToast is recruiting on behalf of this company for a Software Engineer, AI to join their Engineering team in Toronto. They are looking for an engineer with strong backend and machine learning fundamentals who is excited to build practical, high-impact AI systems powered by large language models.In this role, you will help design and implement retrieval and search systems that enable users to discover relevant, trusted information with ease. You will work across LLM-powered workflows, retrieval pipelines, and evaluation frameworks, contributing to products that are scalable, efficient, and aligned with user needs.This opportunity is well suited to someone who enjoys solving complex technical problems, balancing experimentation with production readiness, and working collaboratively across teams. This company encourages applications from candidates whose experience may not match every qualification exactly but who can demonstrate relevant strengths and potential.ResponsibilitiesDesign and implement retrieval-augmented generation systems and agentic workflows that improve query understanding, document retrieval, and response synthesisBuild and optimize retrieval pipelines using BM25, dense retrieval, hybrid retrieval, and re-ranking techniquesDevelop evaluation pipelines for retrieval and generation systems, including offline metrics and human-in-the-loop evaluation methodsExperiment with query rewriting, expansion, and classification approaches to improve search relevanceCollaborate closely with product partners to bring AI-powered search and insight capabilities into productionProfile, debug, and optimize the latency, scalability, and accuracy of retrieval and generation systemsContribute to data pipeline design for training retrieval and ranking models, including dataset curation, augmentation, and labeling workflowsSupport CI/CD practices and help automate deployment and monitoring for machine learning systemsStay current with emerging approaches in LLMs, retrieval systems, and agent architectures,



and evaluate how they can strengthen product capabilitiesRequirements5+ years of software engineering experienceExperience with information retrieval systems, search relevance, and ranking modelsStrong Python expertise and experience with frameworks such as PyTorch, TensorFlow, or JAXFamiliarity with large language models, prompt engineering, and retrieval-augmented generation pipelinesUnderstanding of evaluation methods for search systems, including offline metrics and user-centered evaluationExperience with vector database technologies such as FAISS, Milvus, Weaviate, Pinecone, or PGVector, as well as traditional search engines such as Elasticsearch or OpenSearchUnderstanding of data pipelines, preprocessing, and large-scale data handlingExperience with cloud infrastructure such as AWS, GCP, or Azure for scalable machine learning workflowsExperience supporting CI/CD pipelines and deployment practices for machine learning systemsKnowledge of query understanding, document summarization, and content enrichment strategiesFamiliarity with automated LLM evaluation approaches, including LLM-as-judge methodologiesSkill in prompt engineering across zero-shot and few-shot approachesAbility to work both independently and collaboratively in a fast-paced environment while balancing research and production prioritiesBenefitsCompetitive compensation with a salary range of CA$115,000–CA$149,000, plus equityExtended health and dental coverage starting from day oneEmployee Stock Option Plan for full-time employeesFlexible vacation policy designed to support balance and wellbeingCareer development support through coaching, feedback,



and performance reviewsAccess to strong tooling and equipment to support your workHybrid work model with in-office collaboration in Toronto on designated daysOpportunities to contribute to meaningful AI product development in a high-impact environmentA workplace committed to belonging, accessibility, and helping employees grow and thriveAn inclusive hiring approach that values transferable skills, equivalent experience, and future potentialApplication ReviewSubmit your application, including your resume and cover letter, through our online portal. Our team will carefully review your qualifications and experiences. We take pride in responding promptly, so if your application aligns with our current opportunities, you’ll hear back from us with next steps. Your journey with Toast begins here, and we’re excited to see what you bring to the table!Application ProcessVetting Call: If your application is successful, we’ll schedule a vetting call with a member of the Toast team. This 30-45 minute informal conversation is designed for us to get to know you better and assess your skills. Be prepared to discuss your past projects, the challenges you’ve tackled, and the impact you’ve made. This is your chance to shine and show us why you’re a outstanding fit for the roles we offer.Profile Creation: Once you’ve impressed us in the vetting call, we’ll create an unbiased profile that highlights your experience while minimizing common biases. Instead, we focus on your skills, industry experience, and the impact you’ve made. This way, your profile reflects your true potential and accomplishments.Client Submission: After crafting your unbiased profile, we submit it to our trusted clients. We work closely with these clients to ensure they understand the value you bring. Throughout their interview process, we remain by your side, providing support and guidance. Our goal is to help you navigate the hiring process smoothly and confidently, ensuring you have the best chance to secure a role that fits your skills and aspirations.#J-18808-Ljbffr

📌 Software Engineer, Ai - C$115,000 - C$149,000 A Year (Toronto)
🏢 Toast
📍 Toronto