Inference Performance Engineer At Baseten (Westmount)

Inference Performance Engineer At Baseten (Westmount)

19 Nov
|
Baseten
|
Westmount

19 Nov

Baseten

Westmount

Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.Key Responsibilities:Implement advanced inference techniques for runtime optimizationOptimize end-to-end performance, identifying bottlenecksProvide clear latency/throughput/cost tradeoffs to stakeholdersBring up recent model architectures on release dayDevelop benchmarking frameworks for performance measurementRequirements:Degree in Computer Science, Engineering, or related fieldProficient in Python, C++, or similar languagesFamiliarity with LLM optimization techniquesStrong experience with ML libraries like PyTorchDeep understanding of GPU architectureMake a significant impact on AI performance with your expertise in inference techniques at Baseten.#J-18808-Ljbffr

📌 Inference Performance Engineer At Baseten (Westmount)
🏢 Baseten
📍 Westmount

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: inference performance engineer at baseten (westmount) / westmount

Subscribe to this job alert:

Get the latest job offers by email for: inference performance engineer at baseten (westmount) / westmount