Who you are

- 5+ years of non-internship skilled software development experience

- Experience as a mentor, tech lead or leading an engineering team

- Bachelor's degree in computer science or equivalent

- Experience with Machine Learning and Large Language Model fundamentals, including architecture, training/inference lifecycles, and optimization of model execution

- Experience in developing and deploying LLMs in production on GPUs, Neuron, TPU or other AI acceleration hardware

- Experience with PyTorch, JIT compilation, and AOT tracing

- 6+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

What the job involves

- As a Sr.

Software Development

Engineer for the Neuron Explorer team, you will design, build, and operate the full stack behind Neuron Explorer — from low-level performance data collection and analysis engines to interactive visualizations and developer workflows

- You will own features end to end, spanning the backend processing pipeline, the web UI, and the CLI, and you will help push our AI-powered recommendation and analysis capabilities that automatically surface bottlenecks and guide optimization

- Design and build performance data collection pipelines and analysis engines that transform raw hardware execution data into actionable insights for Neuron Explorer users





- Develop interactive visualizations and developer workflows that make complex profiling data understandable, helping customers pinpoint bottlenecks across single-node and distributed training workloads

- Own features end to end across the full software development lifecycle — from scoping and design through implementation, testing, deployment, and operations — ensuring reliability and maintainability

- Collaborate with compiler, runtime, and chip architecture teams to surface the right performance information so internal and external customers can optimize AI workloads on Trainium and Inferentia hardware

- Evaluate and integrate generative AI capabilities into Neuron Explorer's recommendation engine, building features that automatically identify optimization opportunities and guide customers toward higher performance

- You will work across the backend processing pipeline, the web UI, and the CLI that make up Neuron Explorer, partnering with compiler, runtime, and chip architecture teams to expose the data customers need to optimize their models

- You will work with senior technical leaders and management to define product direction and deliver it to customers, including teams bringing massive-scale multi-modal large language models to peak performance on Trainium

- We build the full stack of software, servers, and chips to accelerate machine learning at the highest scale

📌 Senior Software Development Engineer (Toronto)
🏢 Amazon
📍 Toronto