DescriptionOn the Alexa Daily Essentials Science and Analytics team, we build intelligence systems that power AI-driven experiences for customer-facing features used by hundreds of millions of people daily. Our team applies foundation models in novel ways — designing agentic systems that reason, plan, and act autonomously over complex data, and rigorously evaluating their performance so that every architecture decision is grounded in measured quality. We're not actively training foundation models. We're pushing the frontier of how they're applied — through agentic architectures, reinforcement learning, retrieval-augmented generation, and evaluation science.As an Applied Scientist II, you will design agentic AI systems that autonomously detect, diagnose, and act on signals across Alexa's product surface. You'll build the evaluation science that validates these systems, prototype novel AI-powered features that create new value for customers, and apply reinforcement learning to improve agent behavior through outcome signals. You'll own science end-to-end — from rapid prototyping through production deployment — working directly with engineers and product leaders to ship systems that impact how millions of customers interact with Alexa daily. This is a role for a scientist who brings rigor to evaluation, creativity to invention, and pragmatism to delivery.Key job responsibilitiesDesign and implement agentic AI systems — multi-step reasoning, tool use, planning, and orchestration — that autonomously surface intelligence and take action over complex, evolving dataApply reinforcement learning techniques to improve agent routing, decision-making, and task resolution quality from outcome signalsBuild evaluation and benchmarking frameworks — automated test suites, LLM-as-judge pipelines, competitive benchmarks, and regression detection across model versions and prompt strategiesPrototype and develop novel AI-powered features — information extraction, proactive recommendations, multi-agent collaboration — from concept through production launchBuild RAG pipelines and knowledge retrieval systems that ground agent reasoning in trusted dataDesign and execute experiments end-to-end — hypothesis generation,



causal analysis, and results interpretation that directly shape product roadmapsCommunicate findings to technical and non-technical audiences — influencing architecture decisions, model selection, and product strategy through rigorous evaluationA day in the lifeYou might start by analyzing reward signal distributions from your latest RL experiment on agent routing — identifying where the policy improved and where exploration is still needed. Mid-morning, you prototype a new cross-feature experience, testing whether extraction models can reliably surface actionable items from customer content. After lunch, you run your eval suite against a new model version — comparing benchmark scores across reasoning depth, tool-use reliability, and output consistency to inform an architecture decision. Later, you pair with an engineer to add a new capability to an agent's tool registry, then validate it doesn't degrade downstream quality. You end the day designing an A/B test for a proactive feature your team is launching.About the teamWe're a small, high-ownership team building agentic intelligence systems for Alexa — one of the world's most widely used AI products, reaching hundreds of millions of customers across devices, languages, and contexts. We apply foundation models in novel ways: systems that reason over temporal data, learn from outcomes through reinforcement, autonomously detect regressions, and surface insights that previously required weeks of manual analysis. Our scientists prototype current features, benchmark rigorously, and ship from research through production. If you want to build at the frontier of applied AI — agentic systems, reinforcement learning, evaluation science — with real users and real impact at Alexa scale,



this is the team.Basic Qualifications3+ years of building machine learning models for business application experiencePh D, or Master's degree and 4+ years of CS, CE, ML or related field experienceExperience in patents or publications at top-tier peer-reviewed conferences or journalsExperience programming in Java, C++, Python or related languageExperience with one of the following areas: machine learning technologies, Reinforcement Learning, Deep Learning, Computer Vision, Natural Language Processing (NLP) or related applicationsPreferred QualificationsExperience in professional software developmentExperience creating novel algorithms and advancing the state of the artExperience designing or working with agentic AI systems (tool-use, multi-step reasoning, RAG, multi-agent orchestration)Experience building automated evaluation frameworks or LLM-as-judge systemsAmazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.The base salary range for this position is listed below. As a total compensation company, Amazon's package may include other elements such as sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon offers comprehensive benefits including health insurance (medical, dental, vision, prescription, basic life & AD&D insurance), Registered Retirement Savings Plan (RRSP), Deferred Profit Sharing Plan (DPSP), paid time off, and other resources to improve health and well-being. We thank all applicants for their interest, however only those interviewed will be advised as to hiring status.CAN, BC, Vancouver - 149,300.00 - 249,300.00 CAD annually#J-18808-Ljbffr

📌 Applied Scientist Ii, Alexa Daily Essentials Science And Analytics (Vancouver)
🏢 Amazon
📍 Vancouver