Transform the future of autonomous workflows with Equifax as an AI Evaluation and Tuning Engineer in Toronto. Your expertise will ensure the reliability and performance of multi-agent systems in a full-time role.This position focuses on enhancing the capabilities of autonomous workflows within Equifax's creative environment. As a key player, you will evaluate Large Language Models (LLMs) to develop robust evaluation frameworks, ensuring agents maintain accuracy and minimize errors. You will collaborate closely with developers, optimize workflows,



and implement guardrails to protect systems in production.Key Responsibilities:Curate and maintain high-quality reference datasets for testingAutomate evaluation pipelines for agent performance metricsAnalyze agent decision-making processes for improvementsOptimize interactions with external APIs and RPA workflowsMonitor deployed agents to mitigate drift and hallucinationsRequirements:3+ years in software quality engineering or ML engineeringHands-on experience with LLM orchestration frameworksStrong skills in JSON schema design and function callingProficient in automated testing and debuggingFamiliarity with Python and observability platformsLeverage your skills to enhance Equifax's AI systems as an Evaluation and Tuning Engineer.#J-18808-Ljbffr

📌 Ai Evaluation And Tuning Engineer At Equifax (Toronto)
🏢 Equifax
📍 Toronto