The Senior Gen AI Engineer will lead the design and development of large language model (LLM) based solutions to support an AI-powered recommendation and assistant platform for insurance sales advisors. This role focuses on architecting scalable Gen AI pipelines from scratch, including Retrieval-Augmented Generation (RAG), agentic workflows, and LLM integrations. The engineer will work closely with data, infrastructure, and engineering teams to develop production-ready AI solutions, evaluate models, and implement robust Gen AI microservices within a secure enterprise cloud environment. The position requires robust expertise in machine learning, NLP, Gen AI technologies, and cloud-native architectures, with the ability to translate business needs into scalable AI solutions.KEY RESPONSIBILITIESArchitect and design LLM-based solutions including RAG pipelines, embeddings, fine-tuning strategies, and evaluation frameworksBuild scalable Gen AI microservices and integrate them with internal enterprise systemsDevelop advanced prompt engineering strategies, agentic workflows, and safety guardrails for LLM systemsEvaluate open-source and commercial LLM models for performance, cost efficiency, and risk mitigationCollaborate with data teams to prepare training datasets, knowledge bases, and analytics pipelinesOversee ingestion and refresh of knowledge bases and data pipelines supporting RAG architecturesImplement monitoring, validation frameworks, and closed-loop measurement to continuously improve AI solution qualityEnsure compliance with enterprise security standards and insurance regulatory requirementsWork with engineering teams to productionize Gen AI solutions using scalable cloud architecturesPartner with business stakeholders to define use cases, requirements, and solution delivery strategiesDocument architecture, data sources, and technical processes supporting AI solutionsPresent insights,



model performance metrics, and business impact to senior stakeholdersSupport change management and adoption strategies for AI-driven solutionsMentor junior engineers and promote best practices in AI engineering and system designCollaborate with cross-functional teams including Data Infrastructure, Backend, and Frontend teamsMaintain accurate task tracking and documentation using tools such as JiraREQUIRED QUALIFICATIONS6+ years of experience in machine learning, artificial intelligence, or NLP engineeringMinimum 2+ years of hands-on experience working with Gen AI and LLM-based applicationsStrong expertise in Retrieval-Augmented Generation (RAG), vector databases, embeddings, and model evaluation techniquesHands-on experience with LLM platforms such as Open AI, Azure Open AI, Anthropic, Llama, or similar modelsExperience designing and deploying Gen AI solutions in production environmentsProficiency in Python and experience building data pipelines for AI systemsStrong knowledge of cloud-native architectures, preferably on Microsoft AzureExperience building scalable AI systems in enterprise environmentsStrong understanding of machine learning techniques and statistical modeling methodsExperience working with SQL, data modeling, and relational or No SQL databasesStrong problem-solving, analytical thinking, and communication skillsAbility to collaborate effectively with cross-functional teams and business stakeholdersBachelor’s degree in Computer Science, Engineering, Mathematics, or equivalent practical experiencePREFERRED QUALIFICATIONSExperience designing agentic AI systems and integrating AI agents into enterprise workflowsFamiliarity with BI and visualization tools such as Power BI or TableauExperience working within financial services or insurance domain environmentsExperience with Hadoop or other distributed data platformsStrong understanding of MLOps or Gen AIOps practices for managing AI lifecycle#J-18808-Ljbffr

📌 Senior Genai Engineer (Toronto)
🏢 Compunnel
📍 Toronto