Elevate your career at Baseten as an AI Inference Software Engineer. This role emphasizes infrastructure development for AI model deployment in a rapid-growing tech workplace. Joining our Inference Stack team means you’ll be involved in impactful projects relating to distributed systems and LLMs.

Your work will primarily focus on delivering reliable infrastructure solutions that enhance model performance and user satisfaction. Collaboration with cross-functional teams will be essential. Key Responsibilities:
Develop infrastructure for large-scale LLM deployment and management
Implement essential platform capabilities like autoscaling and observability
Collaborate with engineers on model performance optimizations




Debug and resolve issues in complex production setups
Ensure best practices in testing and operations are followed

Requirements:
Ph.D. or equivalent in Computer Science or Engineering
Experience with distributed systems or platform engineering
Proven record in production environments focused on scale and latency
Excellent communication and teamwork skills
Interested in developing inference engineering expertise

Bring your skills in software engineering and AI to shape the future of intelligent systems with Baseten.

📌 Ai Inference Software Engineer At Baseten Montreal
🏢 Baseten
📍 Montreal