Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full time position. Build dependable serving systems for high request volumes. Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.

Key Responsibilities

Optimize model serving latency and throughput Containerize models for stable production deployment Profile and tune GPU-based code Design distributed serving across GPUs and nodes Apply quantization, batching, and caching methods

Requirements:

Senior-level software or inference engineering experience Production experience with server-side or learning-based software Machine learning inference optimization framework experience C++, CUDA, Rust, or optimized Python proficiency Distributed systems and container orchestration familiarity Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.

📌 Senior Machine Learning Inference Engineer (Canada)
🏢 Raydar
📍 Canada