Lead/Senior Inference Engineer (Winnipeg)

Lead/Senior Inference Engineer (Winnipeg)

22 Nov
|
Jobgether
|
Winnipeg

22 Nov

Jobgether

Winnipeg

Our partner is looking for a Lead/Senior Inference Engineer based in Canada. The Lead/Senior Inference Engineer will build and operate the production inference infrastructure powering advanced large language models and AI-driven professional applications. This hands-on engineering role focuses on developing a reliable, scalable model-serving platform while optimizing performance, latency, and infrastructure costs. Working within a newly established engineering team, you will help shape its technical direction, engineering practices, and operational standards from the ground up. You will collaborate closely with model training, evaluation, research, and product teams to bring new model releases into production. The role offers significant autonomy and the opportunity to influence infrastructure strategy, reliability, and international platform expansion in a high-stakes, compliance-focused setting. Build, maintain, and operate production-grade model-serving infrastructure supporting large-scale AI workloads. Implement and optimize inference techniques, including batching, caching, quantization, and comparable approaches, to improve latency and reduce operating costs without compromising model quality. Strengthen platform observability, monitoring, and operational visibility as traffic volumes and deployment requirements increase. Develop the operational and compliance foundations required for production growth, including controls and evidence supporting the ISO 27001 compliance path. Establish cost-tracking and attribution mechanisms that support financial planning, as well as GPU-capacity contingency plans that help prevent service interruptions and unnecessary parallel infrastructure costs. Evaluate and document trade-offs between cost, latency, and reliability, communicating technical recommendations to engineering leadership and partner teams.



Work directly with model training and evaluation teams to integrate new model releases into the serving infrastructure. Help establish engineering practices and tools, including on-call processes, incident reviews, onboarding, and operational documentation. Collaborate with research, product, and engineering stakeholders to ensure the serving platform evolves alongside model capabilities and product requirements. Contribute to the team's technical strategy and mentor other engineers as the function grows. Direct experience with model-serving infrastructure and/or inference optimization for large language models, at a scale appropriate to previous roles. Demonstrated experience delivering software end to end, from technical design and implementation through deployment and ongoing operations. Strong autonomy, technical judgment, and ownership, with the ability to operate as an early lead engineer and mentor colleagues as the team expands. Experience with LLM-serving technologies such as vLLM, TensorRT-LLM, Triton, SGLang, or similar frameworks. Exposure to GPU-cluster capacity planning and/or multi-region or multi-cloud deployment environments. Familiarity with systems programming languages such as Rust or Go. Knowledge of systems-level performance optimization, including rate limiting, request routing, and identifying bottlenecks across networking, hardware, and lower-level software. CAD $140,000–$175,000 annual base salary for Ontario, Canada. Potential eligibility for an annual performance bonus based on individual and organizational results. Comprehensive benefits and wellbeing programs, including retirement savings, flexible vacation, and employee incentive programs. Flexible work arrangements, including the possibility of working from anywhere for up to eight weeks per year. Learning and career development opportunities, including skills development and tuition reimbursement. Two paid volunteer days per year, along with opportunities to participate in community projects and environmental and social impact initiatives.

📌 Lead/Senior Inference Engineer (Winnipeg)
🏢 Jobgether
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead/senior inference engineer (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: lead/senior inference engineer (winnipeg) / winnipeg