Build AI evaluation systems and cost controls for Velixo Intelligence from anywhere in Canada, with priority for Quebec candidates. Python or Type Script skills matter.As Velixo’s Applied AI Engineer, you will replace anecdotal quality judgments with evidence for MCP-based ERP querying and governed writebacks. You will build regression suites, instrument Gateway actions, and guide model, prompt, and pricing decisions. The work spans LLM APIs, observability, data analysis, and financial systems.Key Responsibilities: Build regression suites for GIQL, writebacks, and tool selectionRun evaluations before model upgrades and prompt changesInstrument tokens, caching, models, latency, and tenantsEstablish cost-per-action baselines and reduction roadmapsSupply unit cost data for pricing and allowancesRequirements: Production experience building on LLM APIsPrevious experience creating an evaluation harnessHands-on familiarity with Langfuse and promptfooComfort with token accounting and caching strategiesPython or Type Script proficiencyShape Velixo Intelligence through rigorous evaluation, cost engineering, model strategy, and transparent analysis for finance decisions.#J-18808-Ljbffr

📌 Ai Evaluation And Cost Engineer (Montreal)
🏢 Velixo
📍 Montreal