Chai

Senior AI Engineer, AI Inference Systems (UTC-08:00) Pacific Time (US & Canada)

Full-time Employment

250k - 350k USD/year

over 2 years ago

Overview About the job

Founded by a team of Cambridge ex quant-traders and researchers, with over 5 trillion tokens served per month to 5 million users, Chai has quickly established itself as one of the fastest-growing AI startup in Palo Alto.

Team Culture Our leadership promotes a high-velocity, hard-working environment with a focus on reliability and high standards. We value autonomy and expect each member to contribute to the team's success through proactive engagement and innovation.

About The Company Chai

US

1-50employees

Seed Round

Software services

Description Who we are looking for: We need a relentless engineer with 3+ years of experience overseeing and being responsible for optimizing our LLM inference engine. Ensuring they are performant, scalable, and cost-effective. You will work alongside equally talented and driven teammates implementing cutting-edge AI inference engines. We need someone who is reliable and has high standards.





Here we might not be the right fit for you:

We work hard and have a high-velocity environment with lots of growth opportunities.

We value exceptional performance and continuous improvement. We believe that if you aren't constantly learning, you aren't growing.

You will be responsible and accountable for making high-impact decisions that determine Chai's future

Here are the top 2 reasons why you should join us:

Exponential growth. 1 Million MAU. Join the team that gets us to 100 million MAU

Craftsmanship. Build something beautiful

Requirements

Familiar with vLLM, quantization, and current techniques of LLM optimization

3+ years of experience in software engineering

Bachelor or Master degree from a leading academic institution

Here Is Our Tech Stack

Front end: Python, Flutter, Dart

Back end: Python, GCP, Redis, Kubernetes

$250-350K + Equity | PALO ALTO, CA

Interview process

AI interview

Code assessment

Technical assessment

On-site interview

Offer negotiation

📌 Senior AI Engineer, AI Inference Systems (Winnipeg)
🏢 BRiX
📍 Winnipeg