Cohere is seeking a Site Reliability Engineer to enhance AI platform performance. Contribute to deploying robust machine learning systems in a remote-friendly environment.As part of the Model Serving team at Cohere, you will develop and operate a platform for large language model API endpoints. This role requires collaborating with various teams to ensure efficient deployment and optimized performance in high-availability environments. You'll engage with customers to tailor specific deployments that meet their needs, marking a significant impact in AI technology.Key Responsibilities:Build self-service systems for managing servicesAutomate Kubernetes deployments for language modelsEnsure setting observability and resilienceParticipate in on-call rotation for SLO adherenceFoster relationships with internal teams for feedback integrationRequirements:5+ years in production infrastructure engineeringExperience with Kubernetes and large distributed systemsBackground in GCP, Azure, AWS, or similarExcellent troubleshooting and collaboration skillsFamiliarity with GPUs and distributed system technologiesDrive infrastructure excellence and build impactful AI systems as a Site Reliability Engineer at Cohere.#J-18808-Ljbffr

📌 Site Reliability Engineer At Cohere (Toronto)
🏢 Visa Hunt
📍 Toronto