Drive innovation in AI inference systems as a Senior AI Engineer at Chai in Palo Alto, CA. Leverage your software engineering expertise to optimize performance and efficiency. Chai, a rapidly growing AI startup, seeks a talented engineer with over three years of experience in LLM optimization.

You will be pivotal in enhancing our AI inference engine level while collaborating with a dynamic team. The role emphasizes autonomy, high standards, and proactive engagement in development projects. Key Responsibilities:

- Optimize the LLM inference engine for performance
- Ensure scalability and cost-efficiency of AI solutions
- Implement cutting-edge AI technologies with the team
- Make high-impact decisions that influence company direction
- Foster continuous improvement and exceptional performance Requirements:
- 3+ years in software engineering
- Solid knowledge of vLLM and LLM optimization techniques
- Bachelor’s or Master’s degree from a top university
- Familiarity with Python, GCP, and Kubernetes
- Willing to work in a high-velocity environment Elevate AI inference capabilities with your engineering skills and innovative mindset at Chai.

📌 AI Engineer for Inference Systems at Chai (Central Ontario)
🏢 BRiX
📍 Central Ontario