Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes.
Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.
Key Responsibilities: Optimize model serving latency and throughput
Containerize models for reliable production deployment
Profile and tune GPU-based code
Design distributed serving across GPUs and nodes
Apply quantization, batching,



and caching methods
Requirements: Senior-level software or inference engineering experience
Production experience with server-side or learning-based software
Machine learning inference optimization framework experience
C++, CUDA, Rust, or optimized Python proficiency
Distributed systems and container orchestration familiarity
Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.

#J-18808-Ljbffr

📌 Senior Machine Learning Inference Engineer (Manitoba)
🏢 Raydar
📍 Manitoba