19 Nov
|
Cohere
|
Toronto
Build high-performance machine learning systems at Cohere with Kubernetes, distributed systems, and production infrastructure expertise. Work model details are not specified.Cohere seeks Members of Technical Staff for its Model Serving team. You will develop, deploy, and operate the AI platform delivering large language models through easy-to-use API endpoints. The work supports optimized NLP models in low-latency, high-throughput, high-availability environments.Key Responsibilities:Develop the AI platform serving Cohere large language modelsDeploy optimized NLP models to production environmentsOperate low-latency, high-throughput, highly available systemsCollaborate across teams on mission-critical infrastructureCreate customized deployments for customer-specific needsRequirements:5+ years running production infrastructure at large scaleDesign experience with distributed systems and KubernetesExperience supporting GPU workloads on Kubernetes clustersCloud experience with GCP, Azure, AWS, or OCIGolang, C++, or other high-performance server languagesApply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere's scalable Model Serving platform.
📌 Staff Machine Learning Infrastructure Engineer (Toronto)
🏢 Cohere
📍 Toronto