Lead LLM Inference Infrastructure Engineer (Canada)

Lead LLM Inference Infrastructure Engineer (Canada)

22 Nov
|
Jobgether
|
Canada

22 Nov

Jobgether

Canada

Build production inference infrastructure for large language models as a Canada-based Lead/Senior Engineer, optimizing latency, reliability, and costs.

This hands-on engineering role develops scalable model-serving platforms for AI-driven professional applications. You will shape technical direction, engineering practices, and operational standards within a newly established team. Collaboration spans model training, evaluation, research, product, and engineering stakeholders.

Key Responsibilities:

- Build and operate production-grade model-serving infrastructure for large-scale AI workloads
- Optimize batching, caching, quantization, latency, and operating costs
- Strengthen observability, monitoring, and operational visibility
- Integrate recent model releases into serving infrastructure




- Mentor engineers and contribute to technical strategy

Requirements:

- Hands-on Kubernetes or comparable infrastructure engineering experience
- Experience operating model services through scaling and peak traffic
- Large language model serving or inference optimization experience
- Strong distributed systems scalability, availability, and reliability background
- Experience troubleshooting production incidents under real traffic

Apply production infrastructure, distributed systems, and inference optimization expertise to advance reliable large language model serving.

#J-18808-Ljbffr

📌 Lead LLM Inference Infrastructure Engineer (Canada)
🏢 Jobgether
📍 Canada

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (canada) / canada

Subscribe to this job alert:

Get the latest job offers by email for: lead llm inference infrastructure engineer (canada) / canada