About The Role
Tubi is seeking a Senior QA Automation Engineer to lead quality assurance initiatives for our cutting‐edge streaming and AI‐driven product features. This pivotal role involves ensuring exceptional end‐to‐end user experiences, robust streaming playback, and the accuracy and integrity of our AI/ML features across web, mobile, and OTT platforms.
This is a hybrid role based out of our Toronto office. You must be willing to travel to our Toronto office three days per week.
What You'll Do
- Design and lead test strategies for streaming workflows, playback systems, and AI‐powered features.
- Test across platforms (web, mobile, and connected TV) to ensure functional parity and playback stability.
- Validate streaming performance—including ABR logic, encoding pipelines, and DRM integrations—under diverse real‐world conditions.
- Debug with precision using tools like Charles Proxy, Chrome Dev Tools, ADB, and Xcode. Collaborate with data and ML teams to validate AI model updates, recommendations, and personalization accuracy.
- Leverage AI‐assisted QA tools to enhance regression coverage, UI validation, and anomaly detection.
- Contribute to automation and CI/CD frameworks, driving faster, more reliable releases.
- Help drive a shift‐left testing approach by engaging early in the software development lifecycle, partnering with product managers, engineers, and data scientists to identify quality risks, define test strategies, and ensure testability during requirements and design phases.
- Oversee QA deliverables for multiple concurrent releases and ensure seamless sign‐off for production launches.
- Monitor live environments for playback or recommendation anomalies post‐release and elevate issues promptly.
- Continuously improve QA processes, metrics, and reporting for streaming and AI validation.
Your Background
- Bachelor's degree in Computer Science, Software Engineering, or related field, or equivalent hands‐on experience.
- 4+ years of QA Automation experience, preferably in streaming media or VOD/OTT platforms.
- Strong technical knowledge of video streaming protocols (HLS, DASH, MPEG‐TS), DRM systems, and CDN architectures.
- Experience validating AI/ML systems in production—testing model output accuracy, user personalization logic, and algorithm stability.
- Hands‐on experience with test automation tools (Selenium, Appium, Playwright, Puppeteer) and AI‐based visual testing.
- Proficiency in debugging tools and network analysis utilities (Charles Proxy, Chrome Dev Tools).
- Experience managing regression suites and release validation cycles across web, mobile, and connected TV platforms.
- Familiarity with Python, Type Script, or Java Script for scripting and test automation.
- Understanding of data validation, logging pipelines, and A/B testing frameworks.
- Strong analytical and documentation skills, with a proactive approach to cross‐team collaboration.
Nice to Have
- Experience testing machine learning‐driven streaming features such as recommendation systems, ad targeting, or automated metadata tagging.
- Exposure to model evaluation techniques (precision/recall, bias testing, data drift analysis).
- Familiarity with continuous testing and CI/CD environments (Jenkins, Git Hub Actions, CircleCI).
- Understanding of observability tools (Grafana, Kibana, Datadog) for post‐deployment validation.
- Strong ability to triage issues in large distributed systems and collaborate with engineering to resolve root causes.
Pay Range
Toronto, Canada
$99,800 - $142,600 CAD
Benefits
This role is also eligible for an annual discretionary bonus, a long‐term incentive plan, and various advantages including medical/dental/vision, insurance, vacation/paid time off, and other benefits in accordance with applicable plan documents.
Tubi Media Group's perks align with those of Fox Corporation, with additional distinctions such as a Flexible Time Off Policy and a generous Parental Leave Program offering up to 12 weeks of paid bonding leave. Employees also receive a monthly wellness reimbursement.
Equal Opportunity Employer
We are an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, gender identity, disability, protected veteran status, or any other characteristic protected by law.
We will consider for employment qualified applicants with criminal histories consistent with applicable law.
#J-18808-Ljbffr
📌 Senior QA Automation Engineer (Ottawa)
🏢 Tubi
📍 Ottawa