Machine Learning Evaluation Engineers at Apple shape quality for AI features in Creativity Apps from Vancouver, British Columbia. Apply ML evaluation, metrics, and datasets.

This engineer owns evaluation and quality across AI features in Creativity Apps. You will define methodologies, testing strategies, and metrics reflecting creator experiences. The work spans model development, infrastructure, integrated features, and customer-ready quality.

Key Responsibilities

Define evaluation strategies and metrics for models, LLMs, and AI features

Create representative datasets and improve their quality iteratively

Build scalable infrastructure with reproducible runs and tracked baselines

Apply LLMs and agentic workflows to evaluation

Report quality, risks,



recommendations, and resolution progress clearly

Requirements

Five-plus years in machine learning or software engineering

Experience evaluating ML models, LLMs, and AI products

Understanding of data, training, deployment, and monitoring cycles

Proficiency in Python, Swift, or comparable languages

Bachelor’s degree or equivalent experience in a related field

Bring evaluation methodology, dataset quality, scalable infrastructure, and machine learning expertise to Apple’s creative applications.

📌 Machine Learning Evaluation Engineer (Winnipeg)
🏢 Apple
📍 Winnipeg