Senior Java Backend Engineer – GenAI / LLM (Toronto)

Senior Java Backend Engineer – GenAI / LLM (Toronto)

10 Sep
|
Astra North Infoteck
|
Toronto

10 Sep

Astra North Infoteck

Toronto

Job Description Senior Java Backend Developer Java 17+, Spring Boot, Microservices & GenAI/LLM Toronto, ON - Hybrid (4 Days WFO) Experience Required: 7+ years Role Descriptions: Key Responsibilities Design, develop, and maintain high-performance backend services using Java (17+), Spring Boot, and Microservices architecture.

Build and expose RESTful and event-driven APIs supporting enterprise-scale applications.

Integrate Generative AI / LLM capabilities (e.g., text generation, summarization, Q&A;, classification) into backend workflows.

Design, test, and optimize prompts and prompt orchestration strategies to ensure accuracy, determinism, and performance.

Develop AI-aware backend components such as: Prompt templates and prompt pipelines Retrieval-Augmented Generation (RAG) services AI inference orchestration layers Implement secure API integrations with AI platforms and internal data sources, ensuring compliance with enterprise security standards.

Apply prompt versioning, evaluation, and monitoring techniques to improve AI output quality over time.

Ensure nonfunctional requirements: scalability, resiliency, performance, and observability.

Contribute to CI/CD pipelines, containerization, and cloud-native deployments.

Participate in code reviews, architecture discussions, and technical design decisions.

Support production systems and troubleshoot complex backend or AI-integration issues.

Required Technical Skills Core Backend Engineering 5+ years of strong hands-on experience in Java backend development.

Expertise in Java 11/17+, Spring Boot, Spring MVC, Spring Security.

Solid experience in Microservices, REST APIs, and API design (OpenAPI/Swagger).

Experience with containers and cloud platforms (Docker, Kubernetes, Open

Shift, Azure/AWS).

Strong knowledge of SQL and NoSQL databases (e.g., DB2,



PostgreSQL, MongoDB).

Experience in CI/CD, Dev

Ops practices, and automated testing. AI & Prompt Engineering Hands-on experience integrating Large Language Models (LLMs) into backend systems.

Strong understanding of prompt engineering techniques, including: Zero-shot, few-shot, and chain-of-thought prompting Prompt templates and energetic prompt generation Guardrails, validation, and hallucination reduction Experience building RAG-based solutions using vector stores and embeddings.

Familiarity with AI orchestration frameworks or SDKs (enterprise or open-source).

Ability to evaluate prompt and model responses for quality, bias, and consistency.

Security & Compliance Experience implementing OAuth2.0, JWT, SSL/TLS, and secure API patterns.

Awareness of data privacy, PII handling, and AI governance in regulated environments (BFSI preferred).

Requirements Top 3 Required Skills: 1. IBM Financial transaction 2.

Payment flow 3.

Support Modernization Detailed Job Description: Design, develop, and maintain applications built on IBM Financial Transaction Manager (FTM) to support core payments processing.

Contribute to the development of payment flows supporting transaction processing.

Build and support integrations between FTM and upstream/downstream systems using enterprise integration patterns.

Participate in the design, development, testing, deployment, and production support.

Troubleshoot and resolve application and integration issues in a complex, regulated environment.

Collaborate with architecture, QA, and operations teams to ensure platform stability, scalability, and performance.

Support modernization initiatives and enhancements to existing payment hub capabilities.

Produce clear technical documentation and participate in code reviews and knowledge sharing.

📌 Senior Java Backend Engineer – GenAI / LLM (Toronto)
🏢 Astra North Infoteck
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior java backend engineer – genai / llm (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: senior java backend engineer – genai / llm (toronto) / toronto