Shape large language model infrastructure remotely in Canada, focusing on inference optimization and production-ready AI systems at enterprise scale. This Staff Machine Learning Engineer role connects advanced research with practical engineering. You will design scalable AI/ML infrastructure, develop evaluation frameworks, and improve LLM-powered applications. The work includes fine-tuning, distillation, orchestration, MLOps, and LLMOps for reliable intelligent customer engagement experiences.
Key Responsibilities
- Research and implement large language model inference techniques
- Optimize models through fine-tuning, distillation, and related methods
- Design cloud-based infrastructure for streaming and real-time inference
- Develop consistent AI evaluation metrics and tooling
- Deploy, monitor, and continuously improve LLM-powered applications
Requirements:
- At least 8 years of applied AI/ML experience
- Robust Python proficiency and production machine learning experience
- Knowledge of transformers, statistical learning, and large language models
- Extensive MLOps and LLMOps experience at scale
- Experience building cloud services using AWS, GCP, Azure, or comparable platforms Apply staff-level machine learning expertise across Python, LLMOps, evaluation, and scalable cloud AI infrastructure in Canada.