Machine Learning Evaluation Engineer at Apple, focused on ML model quality, LLM evaluation, and AI features for Creativity Apps.
This engineer defines evaluation strategies and metrics for models, products, and use cases. The role builds datasets and scalable infrastructure while driving quality from model development through shipping features. Collaboration spans machine learning engineering, infrastructure, product, and design teams to reflect creators’ experiences.
Key Responsibilities: Define metrics for ML models, LLMs, and AI features
Create representative datasets and improve dataset quality iteratively
Build scalable infrastructure with reproducible runs and tracked baselines
Apply automated judging, test generation, and analysis workflows




Report ship risks and recommendations to wide-ranging audiences
Requirements: Five-plus years in machine learning or software engineering
Experience evaluating ML models, LLMs, and AI products
Understanding of training, deployment, evaluation, and monitoring
Proficiency in Python, Swift, or comparable languages
Bachelor’s degree or equivalent experience in a related field
Apply ML fundamentals, LLM knowledge, dataset curation, and quality reporting to Apple’s creativity applications.

#J-18808-Ljbffr

📌 Machine Learning Evaluation Engineer Apple (Manitoba)
🏢 Apple
📍 Manitoba