Lead innovative AI quality efforts at Nexaminds as a Senior AI Validation Engineer. This remote position focuses on enhancing the reliability of LLMs and advanced AI systems.
Nexaminds is on the lookout for a Senior AI Validation Engineer to innovate in quality assurance practices for non-deterministic systems like Large Language Models. The ideal candidate will bring 7+ years of experience in Quality Engineering, showcasing a robust knowledge base in AI evaluation frameworks. You’ll collaborate with engineering teams to develop automated testing pipelines and implement effective AI guardrails for safety and accuracy.
Key Responsibilities:
• Lead AI validation processes for LLMs and RAG systems • Develop automated testing pipelines integrated into CI/CD • Create comprehensive evaluation frameworks for quality metrics • Implement advanced prompt regression testing methodologies • Establish monitoring workflows for AI output quality
Requirements: • 7+ years in Quality Engineering or a related field • Expertise in AI evaluation and validation frameworks • Hands-on experience with automation tools in Node.js • Knowledge of MongoDB for data handling • Strong interpersonal skills for cross-team collaboration
Shape the future of intelligent machines and ensure AI output reliability at Nexaminds. #J-18808-Ljbffr