Backend Engineer For Inference Optimization (Toronto)

Backend Engineer For Inference Optimization (Toronto)

19 Nov
|
Best AI Tools Wiki
|
Toronto

19 Nov

Best AI Tools Wiki

Toronto

Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services.Candidates for this position must have over five years of backend engineering experience and solid programming skills in Go, Rust, or C++. You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.Key Responsibilities:Establish low-latency serving infrastructure for model inferenceDevelop backend services for the enterprise-level APIImplement batching strategies to maximize throughput efficiencyOptimize model serving and inference processesCollaborate within a remote-first cultureRequirements:5+ years of relevant backend engineering experienceProficiency in Go, Rust, or C++Experience with low-latency and high-throughput systemsKnowledge of model serving optimizationFamiliarity with gRPC, REST APIs, and microservicesUtilize your expertise in backend engineering to drive innovations in model inference at Cohere.

📌 Backend Engineer For Inference Optimization (Toronto)
🏢 Best AI Tools Wiki
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: backend engineer for inference optimization (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: backend engineer for inference optimization (toronto) / toronto