Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.

Apple’s Creativity Apps team seeks an engineer with five or more years in machine learning or software engineering. You will define evaluation methodologies, metrics, and testing strategies for models, large language models, and AI features. Your work connects data curation, infrastructure, quality reporting, and cross-functional collaboration across model development and customer-facing features.

Key Responsibilities:

- Define evaluation strategies and metrics for models, LLMs, and features
- Create representative datasets and improve their quality iteratively




- Build scalable infrastructure with reproducible runs and tracked baselines
- Apply automated judging, test generation, and agentic workflows
- Drive quality issues from model checkpoints through integrated features

Requirements:

- Five or more years in machine learning or software engineering
- Experience evaluating ML models, LLMs, and AI products
- Understanding of data, training, deployment, and monitoring cycles
- Proficiency in Python, Swift, or comparable languages
- Bachelor’s degree or equivalent experience in a related field

Apply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.

📌 Machine Learning Evaluation Engineer (Vancouver)
🏢 Apple
📍 Vancouver