Join to apply for the GPU Cloud Platform Engineer role at Yotta Labs .

About Yotta Labs Yotta

Labs is pioneering the development of a Decentralized Operating System (DeOS) for AI workload orchestration at a planetary scale. Our mission is to democratize access to AI resources by aggregating geo-distributed GPUs, enabling high-performance computing for AI training and inference on a wide spectrum of hardware—from commodity to high-end GPUs. Our platform supports major large language models (LLMs) and offers customizable solutions for current models, facilitating elastic and efficient AI development.

We are seeking a GPU Cloud Platform Engineer to join our core infrastructure team and help build the next-generation AI compute cloud. In this role, you will design, deploy, and operate large-scale, multi-cluster GPU infrastructure across data centers and cloud environments. You will be responsible for ensuring high availability, performance, and efficiency of containerized AI workloads—ranging from LLMs to generative models—deployed in Kubernetes-based GPU clusters.

Build and operate large-scale, high-performance GPU clusters; ensure stable operation of compute, network, and storage systems; monitor and troubleshoot online issues. Conduct performance testing and evaluation of multi-node GPU clusters using standard benchmarking tools to identify and resolve performance bottlenecks. LLMs, video generation models) across multi-cluster environments using Kubernetes; Define and lead Kubernetes multi-cluster configuration standards; Build a unified multi-cluster management and monitoring system to support cross-region resource monitoring, traffic scheduling, and fault failover.

Coordinate with IDC providers for planning and deploying large-scale GPU clusters, networks, and storage infrastructure to support internal cloud platforms and external customer needs.



Bachelor's degree or higher in Computer Science, Software Engineering, Electronic Engineering, or related fields; 3+ years of experience in system engineering or DevOps. ~5+ years of experience in cloud-native development or AI engineering, with at least 2 years of hands-on experience in Kubernetes multi-cluster management and orchestration. ~ hands-on experience with tools such as kubectl, Helm, and expertise in multi-cluster deployment, upgrade, scaling, and disaster recovery. ~ Experience with monitoring tools such as Prometheus and Grafana; has practical experience in GPU fault monitoring and alerting. ~ Hands-on experience with cloud platforms such as AWS, GCP, or Azure; ability to diagnose and resolve performance bottlenecks. ~ Understanding of high-performance communication protocols such as IB, RoCE, NVLink, and PCIe. ~ Proven track record of leading multi-cluster system development or performance optimization projects. Proficiency in CUDA programming and the NCCL communication library; understanding of high-performance GPUs like H100.

Ability to develop standardized inference APIs (RESTful/gRPC) and automation tools using Golang or Python. Hands-on experience with optimization techniques such as model quantization, static compilation, and multi-GPU parallelism; Active engagement with open-source communities such as Hugging Face and GitHub; ability to perform secondary development and optimization based on open-source projects and quickly translate cutting-edge techniques into production-ready multi-cluster solutions. Be part of a visionary team aiming to redefine AI infrastructure.

Work on cutting-edge technologies that bridge AI and decentralized computing. Collaborate with experts from leading institutions and tech companies. Enjoy a flexible, remote work environment that values innovation and autonomy. ai.

Please include links to any relevant projects or contributions. ai Location: Remote (Global) Type: Full-time #

📌 Cloud Platform Engineer (Remote) (Edmonton)
🏢 Yotta Labs
📍 Edmonton