Lead Llm Inference Infrastructure Engineer (Canada)

Lead Llm Inference Infrastructure Engineer (Canada)

22 Nov
|
Jobgether
|
Canada

22 Nov

Jobgether

Canada

Build production inference infrastructure for large language models as a Canada-based Lead/Senior Engineer, optimizing latency, reliability, and costs.
This hands-on engineering role develops scalable model-serving platforms for AI-driven qualified applications. You will shape technical direction, engineering practices, and operational standards within a newly established team. Collaboration spans model training, evaluation, research, product, and engineering stakeholders.

Key Responsibilities

Build and operate production-grade model-serving infrastructure for large-scale AI workloadsOptimize batching, caching, quantization, latency, and operating costsStrengthen observability, monitoring,



and operational visibilityIntegrate new model releases into serving infrastructureMentor engineers and contribute to technical strategyRequirements:
Hands-on Kubernetes or comparable infrastructure engineering experienceExperience operating model services through scaling and peak trafficLarge language model serving or inference optimization experienceStrong distributed systems scalability, availability, and reliability backgroundExperience troubleshooting production incidents under real trafficApply production infrastructure, distributed systems, and inference optimization expertise to advance reliable large language model serving.

📌 Lead Llm Inference Infrastructure Engineer (Canada)
🏢 Jobgether
📍 Canada

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (canada) / canada

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (canada) / canada