Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.

Apple’s Creativity Apps team seeks an engineer with five or more years in machine learning or software engineering. You will define evaluation methodologies, metrics, and testing strategies for models, large language models, and AI features. Your work connects data curation, infrastructure, quality reporting, and cross-functional collaboration across model development and customer-facing features.

Key Responsibilities

Define evaluation strategies and metrics for models, LLMs, and features

Create representative datasets and improve their quality iteratively





Build scalable infrastructure with reproducible runs and tracked baselines

Apply automated judging, test generation, and agentic workflows

Drive quality issues from model checkpoints through integrated features

Requirements

Five or more years in machine learning or software engineering

Experience evaluating ML models, LLMs, and AI products

Understanding of data, training, deployment, and monitoring cycles

Proficiency in Python, Swift, or comparable languages

Bachelor’s degree or equivalent experience in a related field

Apply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.

📌 Machine Learning Evaluation Engineer (Winnipeg)
🏢 Apple
📍 Winnipeg