19 Nov
|
Best AI Tools Wiki
|
Toronto
19 Nov
Best AI Tools Wiki
Toronto
Cohere is looking for a Backend Engineer to specialize in optimizing model inference systems. In this remote-first role, you will create low-latency serving infrastructure for advanced backend services.Candidates for this position must have over five years of backend engineering experience and solid programming skills in Go, Rust, or C++. You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.Key Responsibilities:Establish low-latency serving infrastructure for model inferenceDevelop backend services for the enterprise-level APIImplement batching strategies to maximize throughput efficiencyOptimize model serving and inference processesCollaborate within a remote-first cultureRequirements:5+ years of relevant backend engineering experienceProficiency in Go, Rust, or C++Experience with low-latency and high-throughput systemsKnowledge of model serving optimizationFamiliarity with gRPC, REST APIs, and microservicesUtilize your expertise in backend engineering to drive innovations in model inference at Cohere.
📌 Backend Engineer For Inference Optimization (Toronto)
🏢 Best AI Tools Wiki
📍 Toronto