Machine Learning Evaluation Engineers shape quality for Apple Creativity Apps using model evaluation, datasets, and scalable infrastructure. The role focuses on AI features from development through shipment.
Apple’s Creativity Apps team seeks an engineer with five or more years in machine learning or software engineering. You will define evaluation methodologies, metrics, and testing strategies for models, large language models, and AI features. Your work connects data curation, infrastructure, quality reporting, and cross-functional collaboration across model development and customer-facing features.
Key Responsibilities: Define evaluation strategies and metrics for models, LLMs, and features
Create representative datasets and improve their quality iteratively




Build scalable infrastructure with reproducible runs and tracked baselines
Apply automated judging, test generation, and agentic workflows
Drive quality issues from model checkpoints through integrated features
Requirements: Five or more years in machine learning or software engineering
Experience evaluating ML models, LLMs, and AI products
Understanding of data, training, deployment, and monitoring cycles
Proficiency in Python, Swift, or comparable languages
Bachelor’s degree or equivalent experience in a related field
Apply machine learning, LLM, dataset, and quality expertise to evaluate Apple creativity features at scale.

#J-18808-Ljbffr

📌 Machine Learning Evaluation Engineer (British Columbia)
🏢 Apple
📍 British Columbia