Lead LLM Inference Infrastructure Engineer (Manitoba)

Lead LLM Inference Infrastructure Engineer (Manitoba)

21 Nov
|
Jobgether
|
Manitoba

21 Nov

Jobgether

Manitoba

Build production inference infrastructure for large language models as a Canada-based Lead/Senior Engineer, optimizing latency, reliability, and costs.
This hands-on engineering role develops scalable model-serving platforms for AI-driven skilled applications. You will shape technical direction, engineering practices, and operational standards within a newly established team. Collaboration spans model training, evaluation, research, product, and engineering stakeholders.
Key Responsibilities: Build and operate production-grade model-serving infrastructure for large-scale AI workloads
Optimize batching, caching, quantization, latency, and operating costs
Strengthen observability, monitoring, and operational visibility
Integrate new model releases into serving infrastructure




Mentor engineers and contribute to technical strategy
Requirements: Hands-on Kubernetes or comparable infrastructure engineering experience
Experience operating model services through scaling and peak traffic
Large language model serving or inference optimization experience
Strong distributed systems scalability, availability, and reliability background
Experience troubleshooting production incidents under real traffic
Apply production infrastructure, distributed systems, and inference optimization expertise to advance reliable large language model serving.

#J-18808-Ljbffr

📌 Lead LLM Inference Infrastructure Engineer (Manitoba)
🏢 Jobgether
📍 Manitoba

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (manitoba) / manitoba

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (manitoba) / manitoba