The Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best‑in‑class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best‑in‑class ML training performance with the most teraflops (TFLOPS) of compute power for ML in the cloud.

This is enabled by a cutting‑edge software stack—the AWS Neuron Software Development Kit (SDK)—which includes an ML compiler, runtime and natively integrates into popular ML frameworks, such as PyTorch, TensorFlow and MxNet. The Neuron SDK optimizes performance of complex neural‑net models executed on AWS Inferentia and Trainium. AWS Neuron is used at scale with customers and partners like PyTorch, Epic Games, Snap, AirBnB, Autodesk, Amazon Alexa, Amazon Rekognition and other customers in various segments.

Lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. Leverage vision and technical communication skills as a hands‑on partner to AWS ML services teams, contributing to pre‑silicon design, new product releases, optimizations, and features that meet customer needs. Drive software architecture efficiencies, implement automation, resolve root causes of defects, and build high‑impact solutions for a large customer base.





Design and code solutions that drive software architecture efficiencies. Deliver high‑impact solutions to a large customer base. Work cross‑functionally to influence business decisions with technical input.

Operate in a startup‑like environment, tackling the most key projects. 8+ years of direct engineering work experience. ~Demonstrated software engineering skills through relevant experience (internships, work, competitions, publications) and strong analytical, attention‑to‑detail and effective communication skills. D. in Computer Science or related technical field.

Experience with toolchains (LLVM, GCC) and code‑generation techniques for new hardware. Knowledge of compiler internals from front end to runtime with emphasis on AI acceleration. Toronto, Canada – candidates must be currently located or willing to relocate.

Base salary range: 214,200.00 – 357,800.00 CAD annually. Amazon is an equal‑prospect employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, visit for more information. #

📌 Software Development Manager (work from home) (Toronto)
🏢 Amazon Web Services (AWS)
📍 Toronto