Elevate your career at Baseten as an AI Inference Software Engineer. This role emphasizes infrastructure development for AI model deployment in a rapid-growing tech environment.Joining our Inference Stack team means you'll be involved in impactful projects relating to distributed systems and LLMs. Your work will primarily focus on delivering reliable infrastructure solutions that enhance model performance and user satisfaction. Collaboration with cross-functional teams will be essential.Key Responsibilities:Develop infrastructure for large-scale LLM deployment and managementImplement essential platform capabilities like autoscaling and observabilityCollaborate with engineers on model performance optimizationsDebug and resolve issues in complex production setupsEnsure best practices in testing and operations are followedRequirements:Ph.D. or equivalent in Computer Science or EngineeringExperience with distributed systems or platform engineeringProven record in production environments focused on scale and latencyExcellent communication and teamwork skillsInterested in developing inference engineering expertiseBring your skills in software engineering and AI to shape the future of intelligent systems with Baseten.#J-18808-Ljbffr

📌 Ai Inference Software Engineer At Baseten (Montreal)
🏢 Baseten
📍 Montreal