Machine Learning Evaluation Engineer at Apple, focused on ML model quality, LLM evaluation, and AI features for Creativity Apps.This engineer defines evaluation strategies and metrics for models, products, and use cases. The role builds datasets and scalable infrastructure while driving quality from model development through shipping features. Collaboration spans machine learning engineering, infrastructure, product, and design teams to reflect creators’ experiences.Key Responsibilities:

Define metrics for ML models, LLMs, and AI featuresCreate representative datasets and improve dataset quality iterativelyBuild scalable infrastructure with reproducible runs and tracked baselinesApply automated judging, test generation, and analysis workflowsReport ship risks and recommendations to diverse audiencesRequirements:

Five-plus years in machine learning or software engineeringExperience evaluating ML models, LLMs, and AI productsUnderstanding of training, deployment, evaluation, and monitoringProficiency in Python, Swift, or comparable languagesBachelor’s degree or equivalent experience in a related fieldApply ML fundamentals, LLM knowledge, dataset curation, and quality reporting to Apple’s creativity applications.

📌 Machine Learning Evaluation Engineer Apple (Winnipeg)
🏢 Apple
📍 Winnipeg