Lead Llm Inference Infrastructure Engineer (Ottawa)

Lead Llm Inference Infrastructure Engineer (Ottawa)

22 Nov
|
Jobgether
|
Ottawa

22 Nov

Jobgether

Ottawa

Build production inference infrastructure for large language models as a Canada-based Lead/Senior Engineer, optimizing latency, reliability, and costs.This hands-on engineering role develops scalable model-serving platforms for AI-driven professional applications. You will shape technical direction, engineering practices, and operational standards within a newly established team. Collaboration spans model training, evaluation, research, product, and engineering stakeholders.Key Responsibilities:Build and operate production-grade model-serving infrastructure for large-scale AI workloadsOptimize batching, caching, quantization, latency, and operating costsStrengthen observability, monitoring,



and operational visibilityIntegrate current model releases into serving infrastructureMentor engineers and contribute to technical strategyRequirements:Hands-on Kubernetes or comparable infrastructure engineering experienceExperience operating model services through scaling and peak trafficLarge language model serving or inference optimization experienceStrong distributed systems scalability, availability, and reliability backgroundExperience troubleshooting production incidents under real trafficApply production infrastructure, distributed systems, and inference optimization expertise to advance reliable large language model serving.

📌 Lead Llm Inference Infrastructure Engineer (Ottawa)
🏢 Jobgether
📍 Ottawa

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (ottawa) / ottawa

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (ottawa) / ottawa