Lead AI quality initiatives within Sony Interactive Entertainment’s Information Security team, validating nondeterministic models and release readiness.
This senior quality engineering role supports ML-powered products and services through model monitoring, statistical evaluation, and automation. You will separate model variance from quality regressions while coordinating risks and dependencies. Collaboration spans ML, engineering, product, infrastructure, and embedded QE teams.
Key Responsibilities:
- Build automated validation for probabilistic ML and LLM outputs
- Assess ranking behavior, score distributions, and response quality
- Drive quality across complex cross-functional machine learning projects
- Perform performance and reliability testing for distributed systems
- Establish scalable quality standards, tooling, and guidelines
Requirements:
- Bachelor’s degree in Computer Science or equivalent
- Experience with AI evaluation, monitoring, or human review workflows
- Proficiency developing automation in Python, Java, or JavaScript
- Understanding of SDLC, Agile methodologies, and release processes
- Solid problem-solving, debugging, and communication skills
Lead dependable AI quality through statistical validation, risk management, and scalable automation at Sony Interactive Entertainment.
📌 Senior AI Quality Engineer Machine Learning (London)
🏢 Sony
📍 London