Hi,
We have a position which is suitable to your skillset. Please go through the below JD and let me know your interest.
Title : AI Data Engineer
Location : Canada
Relevant Experience (in Yrs.): 8+ years
Detailed :
What You Will Do
- Data Pipelines: Build ETL flows for structured/unstructured data, ensuring normalization, deduplication, and semantic consistency.
- Vector Infrastructure: Manage pgvector, Azure AI Search, Redis vector indexing, and hybrid search layers.
- Data Governance: Implement zero-trust access, privacy controls, and compliance within AI context pipelines.
- Real-time Processing: Build event-driven architectures that continuously refresh embeddings and indexes.
Required Qualifications
- Deep experience with distributed data systems, SQL, and orchestration tools.
- Experience tuning high-throughput database infrastructure.
- Knowledge of Google’s GECX is a plus.
- Familiarity with chunking strategies and embedding models.
Skillset Requirements
- ETL & Data Modelling: Designing pipelines for structured/unstructured data, normalization, deduplication, and semantic consistency.
- Vector Databases:
pgvector, Redis, Azure AI Search, hybrid search, and index optimization.
- Distributed Data Systems: Kafka, Spark, Flink, or similar event-driven architectures.
- Data Governance: Zero-trust access, privacy controls, compliance, and auditability.
Real-time Embedding Updates: Event-driven refresh pipelines for RAG and agent memory systems.
- Chunking & Embeddings: Semantic chunking, metadata tagging, and embedding model selection.
- Search Infrastructure: BM25, hybrid search, inverted indexes, and ranking algorithms.
- Performance Tuning: High-throughput read/write optimization.
- Data Quality & Lineage: Validation, schema enforcement, and lineage tracking (e.g., Excellent
- Expectations, Open Lineage).
Thanks & Regards
Venkatesh Kundurthi
Recruitment Manager || ASCII Group, LLC
Office: (248)-476-7600 Ext. 104; Direct: +1 (phone hidden)
38345 W. 10 Mile Rd, Ste.#365; Farmington, MI 48335
Email:
[email protected]
Website: www.asciigroup.com
📌 AI Data Engineer (Toronto)
🏢 Ascii Group
📍 Toronto