About GSPANN

Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and. With five global delivery centers and 2000+ employees, we provide the intimacy of a boutique consultancy with the capabilities of a large IT services firm.

Role: AI Platform Engineers

Location : Remote-(Canada)

Duration: Long term The AI DevOps/Platform Engineer will join the AI Enablement team, focusing on building, maintaining, and scaling enterprise AI infrastructure. This includes proprietary agent orchestration platforms (NOVA), AI gateway services, and Retrieval-Augmented Generation (RAG) pipelines across multi-cloud environments.

Key Responsibilities:

Platform Development & Operations:

- Develop, deploy, and maintain the NOVA agentic AI platform
- Manage LiteLLM as the central AI gateway
- Optimize LLM routing, cost control, load balancing, and failover
- Implement monitoring and observability (Prometheus, Grafana, OpenTelemetry)

RAG Pipeline Development:

- Design and optimize RAG pipelines
- Maintain document ingestion, chunking, embeddings, and vector stores
- Build RAG on GCP and Azure using managed AI services and vector databases

Infrastructure & DevOps:

- Deploy AI services on Kubernetes (AKS, GKE)
- Implement CI/CD with Jenkins, Opsera, GitHub Actions
- Automate infrastructure (Terraform, Helm, GitOps)
- Ensure security and compliance





Agentic AI & Automation:

- Develop automation tools and scripts
- Build MCP servers for tool integrations
- Enable multi-agent orchestration and autonomous workflows
- Create SDKs, APIs, and developer documentation

Required Qualifications:

- 8+ years platform engineering/DevOps experience
- 2+ years AI/ML or LLM platform experience
- Strong Kubernetes, CI/CD, and cloud experience (GCP or Azure)
- Proficiency in Python and/or TypeScript

Technical Environment:

- AI Platforms: LiteLLM, LangChain, LangGraph
- Cloud: GCP, Azure
- Containers: Kubernetes, Docker, Helm
- CI/CD: Jenkins, GitHub Actions, Opsera
- Observability: Prometheus, Grafana, OpenTelemetry, Dynatrace
- Languages: Python, TypeScript, Bash

Working at GSPANN GSPANN is a diverse, prosperous, and rewarding place to work. We provide competitive benefits, educational assistance, and career growth opportunities to our employees. Every employee is valued for their talent and contribution. Working with us will give you an opportunity to work globally with some of the best brands in the industry.

The company does and will take affirmative action to employ and advance in the employment of individuals with disabilities and protected veterans and to treat qualified individuals without discrimination based on their physical or mental disability status. GSPANN is an equal chance employer for minorities/females/veterans/disabled.

📌 AI Platform Engineer (Canada)
🏢 GSPANN Technologies
📍 Canada