Lead creative AI quality efforts at Nexaminds as a Senior AI Validation Engineer. This remote position focuses on enhancing the reliability of LLMs and advanced AI systems. Nexaminds is on the lookout for a Senior AI Validation Engineer to innovate in quality assurance practices for non-deterministic systems like Large Language Models.

The ideal candidate will bring 7+ years of experience in Quality Engineering, showcasing a strong knowledge base in AI evaluation frameworks. You’ll collaborate with engineering teams to develop automated testing pipelines and implement effective AI guardrails for safety and accuracy. Key Responsibilities:

- Lead AI validation processes for LLMs and RAG systems
- Develop automated testing pipelines integrated into CI/CD




- Create comprehensive evaluation frameworks for quality metrics
- Implement advanced prompt regression testing methodologies
- Establish monitoring workflows for AI output quality Requirements:
- 7+ years in Quality Engineering or a related field
- Expertise in AI evaluation and validation frameworks
- Hands-on experience with automation tools in Node.js
- Knowledge of MongoDB for data handling
- Strong interpersonal skills for cross-team collaboration Shape the future of intelligent machines and ensure AI output reliability at Nexaminds.

📌 Senior AI Validation Engineer Remote (Vancouver)
🏢 Worky
📍 Vancouver