We are seeking an experienced Observability Engineer to join our Enterprise Kubernetes Platform team at a leading financial services organization.
You’ll own the complete observability stack across 50+ production Kubernetes clusters, providing metrics, logging, tracing, and alerting capabilities that ensure exceptional reliability and performance for mission-critical applications.
This role combines deep technical expertise in up-to-date observability tools with emerging AI/ML capabilities to build intelligent monitoring solutions, predictive alerting, and self-healing infrastructure.
WHAT YOULL DO
Design, deploy, and maintain enterprise-scale observability infrastructure including Prometheus, Grafana, Thanos, Loki, and up-to-date collection agents
Manage observability deployments using GitOps principles and infrastructures code
Implement long-term metrics storage solutions with cloud object storage
Maintain and upgrade observability components across development, QA, UAT, production, and DR settings
Configure distributed observability architecture spanning multiple datacenters and cloud providers
METRICS & MONITORING
Design and implement Prometheus monitoring strategies for Kubernetes infrastructure and containerized applications
Create Service Monitors, Pod Monitors for automated metrics collection
Develop rules for intelligent alerting with minimal false positives
Configure multi-cluster metrics federation and aggregation
Optimize metrics cardinality, storage deficiency, and query performance.