Elevate your career at Baseten as an AI Inference Software Engineer. This role emphasizes infrastructure development for AI model deployment in a fast-growing tech workplace.
Joining our Inference Stack team means you’ll be involved in impactful projects relating to distributed systems and LLMs. Your work will primarily focus on delivering reliable infrastructure solutions that enhance model performance and user satisfaction. Collaboration with cross-functional teams will be essential.
Key Responsibilities:
• Develop infrastructure for large-scale LLM deployment and management
• Implement essential platform capabilities like autoscaling and observability
• Collaborate with engineers on model performance optimizations




• Debug and resolve issues in complex production setups
• Ensure best practices in testing and operations are followed
Requirements:
• Ph.D. or equivalent in Computer Science or Engineering
• Experience with distributed systems or platform engineering
• Proven record in production environments focused on scale and latency
• Excellent communication and teamwork skills
• Interested in developing inference engineering expertise
Bring your skills in software engineering and AI to shape the future of intelligent systems with Baseten.
#J-18808-Ljbffr

📌 AI Inference Software Engineer at Baseten (Montreal)
🏢 Baseten
📍 Montreal