Senior Analyst, AI Performance (Winnipeg)

Senior Analyst, AI Performance (Winnipeg)

21 Nov
|
WestJet Group
|
Winnipeg

21 Nov

WestJet Group

Winnipeg

Position Overview: The Senior Analyst, AI Performance & Reliability is accountable for the health, performance and reliability of AI and machine learning solutions in production. The role monitors AI services and model behaviour, identifies emerging issues, coordinates incident response, and drives improvements that keep solutions secure, available, cost-effective and performing as expected.

The role provides ongoing visibility into service availability, latency, errors, usage, cost, data quality and output quality, including model drift and unexpected or inappropriate results. Working closely with AI / ML Developers, Data Scientists, platform teams, business owners, security and governance teams, the role helps ensure production AI and ML solutions can be trusted to operate consistently and recover effectively when issues occur.

Key Deliverables:

Accountable for keeping AI and ML solutions reliable, available and performing as expected through effective monitoring, incident management, troubleshooting, service recovery and continuous improvement.

Monitor AI and ML solutions in production, including availability, latency, errors, throughput, usage, cost, data quality and output quality.

Build and maintain dashboards, alerts, health checks and reusable monitoring patterns that provide timely visibility into solution health.

Detect model drift, data changes, degraded performance, unexpected outputs, harmful or inappropriate responses and other signs of service deterioration.

Work with business and technical owners to define reliability targets, service expectations, operational thresholds and escalation triggers.

Produce regular operational reporting and communicate material trends, risks and service issues to appropriate stakeholders.





Lead the investigation, triage and coordination of production incidents affecting AI and ML solutions.

Assess business and operational impact, establish incident priority, and coordinate response activities across technical and business teams.

Troubleshoot issues across applications, APIs, models, data pipelines, platforms and infrastructure to identify likely causes and required actions.

Coordinate with AI / ML Solutions Developers and platform teams when rollbacks, configuration changes, model replacements, fixes or redeployments are required.

Validate service recovery and confirm that the solution, monitoring controls and outputs are operating as expected.

Conduct post-incident reviews, document root causes and lessons learned, and track corrective and preventive actions to completion.

Maintain support procedures, runbooks, escalation paths, contact lists and recovery plans.

Identify and address risks that could affect solution reliability, availability, performance, resilience or recovery.

Improve monitoring coverage, alert quality, recovery practices, automation and operational support processes.

Assess production readiness and confirm that appropriate monitoring, support documentation, escalation processes and recovery procedures are in place before release.

Support capacity,



performance and cost optimization by identifying constraints, inefficient usage patterns and emerging demand.

Partner with AI / ML Solutions Developers, Data Scientists and platform teams to prevent repeat incidents and improve solution supportability.

Contribute operational requirements and lessons learned to solution design, testing and lifecycle decisions.

Monitor model and AI output performance against defined technical, quality and business acceptance measures.

Identify changes in source data, knowledge sources, user behaviour or business conditions that may affect solution performance.

Analyze feedback, exceptions and performance trends to determine when investigation, correction, tuning or retraining may be required.

Escalate identified model or output concerns to the accountable solution, model, business and governance owners.

Maintain traceable records of identified issues, thresholds, findings and follow-up actions.

Monitor production safeguards and elevate material reliability, privacy, security, responsible AI, model risk or compliance concerns.

Support operational evidence, reporting and documentation required for governance reviews, audits and oversight.

Confirm that access, logging, monitoring and incident-management practices follow approved enterprise requirements.

Help define and improve reliability standards, service-health measures, operational controls and reusable monitoring practices.

Promote consistent incident, problem-management and continuous-improvement practices across AI teams.

Use monitoring, incident, usage, cost and feedback data to identify opportunities to improve reliability, perfor

📌 Senior Analyst, AI Performance (Winnipeg)
🏢 WestJet Group
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior analyst, ai performance (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: senior analyst, ai performance (winnipeg) / winnipeg