On LLMOp/DevOps they are looking for people who have setup and operated the Agentcore runtime workplace.

DevOps

MUST

AI-DLC practices

Agentic code generation (Claude Code SDK, Kiro CLI) with human-in-the-loop checkpoints

GitHub Actions: reusable workflows, environments and approvals, OIDC federation to AWS

Container image builds and Amazon ECR (AgentCore Runtime requires ARM64 images)

AgentCore Runtime deployment (versions, endpoints, rollback) and VPC mode

VPC endpoints / PrivateLink and security groups

Terraform

IAM for CI/CD

SHOULD

AgentCore Gateway rate limits and PortKey admin API (kill switch)

Game-day practice with audit evidence

Image signing (Cosign)

Python

COULD

Strands Agents SDK





Backstage templates

ROSA / OpenShift networking (later phase)

AI eng

MUST

AgentCore Evaluations and Bedrock evaluation

Golden-dataset design and curation with SMEs

LLM-as-judge design and calibration against human labels

Integrating evaluations as a CI gate

Langfuse / OpenTelemetry

Python

SHOULD

RAGAS or equivalent

Trajectory evaluation

Understanding of agentic red-teaming results (to feed them into the gate)

COULD

Bedrock Guardrails

#J-18808-Ljbffr

📌 GenAI DevOps Engineer / AI Engineer (Manitoba)
🏢 Accion Labs
📍 Manitoba