Toronto, Ontario M5V 3L9 Posted September 23rd, 2026

Job Type: Full Time

Job Category: IT

OBSERVABILITY ENGINEER

Job Type: Full Time

Location: Toronto, ON

Work Model: Onsite / 4 Days

Primary Skills: Prometheus & Grafana, Kubernetes Observability, GitOps & Infrastructure as Code

About the Role

We are seeking an experienced OBSERVABILITY ENGINEER to join an Enterprise Kubernetes Platform team within a leading financial services organization. The role will own the observability stack across 50 production Kubernetes clusters, delivering metrics, logging, tracing, and alerting capabilities for mission-critical applications.

The position combines deep expertise in modern observability technologies with emerging AI/ML capabilities to enable intelligent monitoring, predictive alerting, and self-healing infrastructure.

Key Responsibilities

Observability Infrastructure

- Design, deploy, and maintain enterprise-scale observability infrastructure using Prometheus, Grafana, Thanos, Loki, and modern collection agents.
- Manage observability deployments using GitOps principles and Infrastructure as Code (IaC).
- Implement long-term metrics storage solutions using cloud object storage.
- Maintain and upgrade observability components across Development, QA, UAT, Production, and DR environments.
- Configure distributed observability architectures across multiple data centers and cloud providers.
- Ensure observability platforms meet enterprise reliability, scalability, and performance requirements.

Metrics & Monitoring

- Design and implement Prometheus monitoring strategies for Kubernetes infrastructure and containerized applications.
- Create ServiceMonitors and PodMonitors for automated metrics collection.
- Develop intelligent alerting rules while minimizing false positives.
- Configure multi-cluster metrics federation and aggregation.
- Optimize metrics cardinality, storage efficiency, and query performance.




- Monitor platform health and application performance across large-scale Kubernetes environments.

AI/ML & Intelligent Observability

- Explore and implement AI/ML capabilities for intelligent monitoring and predictive alerting.
- Contribute to self-healing infrastructure and automated remediation capabilities.
- Identify opportunities to improve operational efficiency through automation and intelligent observability.

Required Skills & Qualifications

- Strong experience with enterprise observability platforms.
- Hands-on expertise with Prometheus, Grafana, Thanos, and Loki.
- Solid Kubernetes monitoring and observability experience.
- Experience with metrics collection, logging, alerting, and distributed tracing.
- Experience with GitOps practices and Infrastructure as Code.
- Strong understanding of Kubernetes architecture and containerized applications.
- Experience with multi-cluster and multi-environment observability.
- Knowledge of cloud object storage and cloud platforms.
- Strong understanding of metrics cardinality, storage optimization, and query performance.
- Strong troubleshooting, analytical, and problem-solving skills.

Preferred Qualifications

- Experience implementing AI/ML-driven observability or AIOps solutions.
- Experience with self-healing infrastructure and predictive monitoring.
- Experience supporting large-scale financial services or other mission-critical environments.
- Familiarity with multiple cloud providers and distributed data center architectures.
- Experience working across Development, QA, UAT, Production, and DR environments.

Job Details

- Job Type: Full Time
- Location: Toronto, ON
- Work Model: Onsite / 4 Days

Required Skills

AWS Application Engineer Axiom Developer Change Manager Cloud Developer DevOps Engineer Full Stack Developer Graphic Design Consultant Matillion ELT Developer Mobile Architect Salesforce Commerce Cloud Consultant Web Development & Analytics Consultant

📌 OBSERVABILITY ENGINEER (Toronto)
🏢 Realign
📍 Toronto