19 Apr
|
Refinitiv
|
Toronto
Apply on Kit Job: kitjob.ca/job/2g8nq9
Lead the technical strategy for ingestion and indexing in the search platform. Drive system design, Kafka integration, and operational health while ensuring efficient document processing and AI-driven automation.
This Staff Software Engineer role requires expertise in document ingestion systems and indexing management. You'll architect a Kafka-based pipeline, optimize for performance, and oversee the impacts of migration from OpenSearch to Vespa. A strong emphasis on end-to-end ownership, including model operationalization and search quality, is essential to meet demanding requirements.
Key Responsibilities:
• Architect the end-to-end ingestion pipeline • Design custom models for real-time document updates • Manage zero-downtime index operations • Lead the migration from OpenSearch to Vespa • Instrument pipeline for observability and fault tolerance
Requirements: • Expertise in Kafka streaming architecture • Proficiency in search engine management techniques • Strong background in AI model integration • Experience with cloud-based operational frameworks • Proven track record in system design and architecture
Embrace this opportunity to engineer scalable solutions that drive creative search capabilities and elevate system performance. #J-18808-Ljbffr
Apply on Kit Job: kitjob.ca/job/2g8nq9
📌 Staff Engineer for Search Pipeline Design (Toronto)
🏢 Refinitiv
📍 Toronto