Position: AI Software Engineer (Java & Python)

Location: Hybrid (4days/week)- Toronto, ON

Job type: Full-Time/Permanent Hiring

We are seeking an experienced AI Software Engineer with a minimum of 6–8 years of experience and robust Java and Python skills to build and productionize secure, scalable Generative AI, LLM, RAG, and agentic AI solutions within a regulated banking environment.

Key Responsibilities

- Design, develop, test, deploy, and support AI-enabled enterprise applications using Java and Python.
- Build Generative AI solutions including RAG, conversational assistants, enterprise search, summarization, and workflow automation.
- Develop agentic AI capabilities using tool/function calling, orchestration, guardrails, and human-in-the-loop controls.
- Integrate LLMs, APIs, vector databases, enterprise data sources, and existing applications.
- Build scalable REST APIs and microservices using modern Java and Python frameworks.
- Implement prompt engineering, embeddings, document chunking, retrieval, reranking, and grounded response generation.
- Develop AI evaluation and regression frameworks covering accuracy, groundedness, safety, latency, reliability, and cost.
- Apply MLOps/LLMOps, including CI/CD, containerization, version control, monitoring, and production support.
- Apply enterprise security, privacy, IAM, responsible AI, and model-risk controls.




- Collaborate with business, product, architecture, data, security, and engineering teams to take AI use cases from prototype to production.
- Participate in code reviews, troubleshooting, technical documentation, and engineering mentorship.

Required Skills

- Strong hands-on Java and Python development.
- Experience building Generative AI / LLM applications.
- Strong experience with RAG, embeddings, vector search, retrieval, and prompt engineering.
- Experience with Agentic AI, tool/function calling, and orchestration.
- Solid REST API and microservices development experience.
- Experience integrating LLMs with enterprise applications and data sources.
- Knowledge of AI evaluation, testing, LLMOps/MLOps, CI/CD, and production monitoring.
- Understanding of enterprise security, privacy, and responsible AI practices.

Preferred Skills

- Azure OpenAI, Azure AI Search, or other cloud AI platforms.
- LangChain, LlamaIndex, Semantic Kernel, or similar frameworks.
- Vector databases and enterprise knowledge platforms.
- Model Context Protocol (MCP) and multi-agent orchestration.
- AI governance, content safety, and model-risk controls.
- Banking or financial services experience.
- GitHub Copilot or other AI-assisted development tools.

📌 AI Software Engineer (Java & Python) (Ontario)
🏢 Ku0026amp;K Global Talent Solutions
📍 Ontario