Backend Engineer — Model Inference (Toronto)

Backend Engineer — Model Inference (Toronto)

19 Nov
|
Best AI Tools Wiki
|
Toronto

19 Nov

Best AI Tools Wiki

Toronto

Cohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API.Requirements5+ years of backend engineering experienceStrong proficiency in Go, Rust, or C++Experience with high-throughput, low-latency systemsKnowledge of model serving and inference optimizationExperience with gRPC, REST APIs, and microservicesNice to HaveExperience with vLLM, TensorRT-LLM, or similarFamiliarity with GPU memory managementExperience with continuous batching techniquesEquity in a well-funded AI startupPremium health and dentalRemote-first cultureHome office budgetAnnual learning stipendFlexible PTOSkillsGo Rust Model Serving Backend Engineering gRPC Inference OptimizationThis listing was posted on 2026-02-17 and is almost certainly closed. It is kept for reference — check the employer's own careers page for current openings.Vincony has all 400+ AI models in one place — compare responses, AI debate, Image/Video/Voice generator, and 20 more tools to help you learn and build with AI.

📌 Backend Engineer — Model Inference (Toronto)
🏢 Best AI Tools Wiki
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: backend engineer — model inference (toronto) / toronto