22 Nov
|
Jobgether
|
Ottawa
Build production inference infrastructure for large language models as a Canada-based Lead/Senior Engineer, optimizing latency, reliability, and costs.This hands-on engineering role develops scalable model-serving platforms for AI-driven professional applications. You will shape technical direction, engineering practices, and operational standards within a newly established team. Collaboration spans model training, evaluation, research, product, and engineering stakeholders.Key Responsibilities:Build and operate production-grade model-serving infrastructure for large-scale AI workloadsOptimize batching, caching, quantization, latency, and operating costsStrengthen observability, monitoring,
and operational visibilityIntegrate current model releases into serving infrastructureMentor engineers and contribute to technical strategyRequirements:Hands-on Kubernetes or comparable infrastructure engineering experienceExperience operating model services through scaling and peak trafficLarge language model serving or inference optimization experienceStrong distributed systems scalability, availability, and reliability backgroundExperience troubleshooting production incidents under real trafficApply production infrastructure, distributed systems, and inference optimization expertise to advance reliable large language model serving.
📌 Lead Llm Inference Infrastructure Engineer (Ottawa)
🏢 Jobgether
📍 Ottawa