Build production-grade AI infrastructure with Python and FastAPI at EPAM Systems, supporting enterprise knowledge systems and reliable retrieval. Work across backend services and observability.
As a Python AI Engineer, you will evolve a Confluence-focused RAG chatbot into a broader agentic knowledge system. You will use Pydantic, SQLAlchemy async, asyncpg, and up-to-date retrieval pipelines. Your work will support ingestion, evaluation, agent runtime capabilities, and shared conversational platform primitives.

Key Responsibilities

Architect backend services with Python 3.11 and FastAPIDesign retrieval trade-offs involving quality, latency, cost, and safetyBuild agent memory boundaries, tool sandboxing, permissions, and budget controlsImprove grounding, failure analysis,



and citation enforcementCreate observability using OpenTelemetry, Prometheus/Grafana, Docker, Helm, and GitHub ActionsRequirements:
Strong hands-on Python experience in infrastructure-heavy environmentsExperience building CLI tools with Python, Golang, or RustHands-on LangGraph, LangChain, pgvector, and retrieval pipeline experienceExperience designing LLM evaluation frameworks and regression detectionStrong Docker, Helm, GitHub Actions, and Kubernetes workflow experienceApply Python, retrieval, agent infrastructure, and observability expertise to dependable enterprise AI systems at EPAM Systems.

📌 Python Ai Infrastructure Engineer (Canada)
🏢 EPAM Systems
📍 Canada