06 Sep
|
HR Ways
|
Winnipeg
Elevate your career as a Data Engineer with a prestigious global IT firm in Brampton, Ontario. Your expertise will drive data pipelines, ETL processes, and governing data structures effectively in office.
This role requires 5 to 7 years of deep experience in distributed data systems and SQL. You will build ETL flows and manage a robust vector infrastructure including Azure AI Search and Redis. As a Data Engineer, your contributions will ensure compliance and seamless real-time processing within data pipelines.
Key Responsibilities: • Build ETL flows for structured and unstructured data • Manage pgvector and Redis for vector indexing • Implement zero-trust access and privacy controls • Develop architectures for real-time data processing • Normalize and deduplicate incoming data streams
Requirements: • Deep experience with distributed data systems and SQL • Proven skills in tuning high-throughput databases • Knowledge of Google's GECX is an asset • Familiarity with embedding models and chunking strategies • Experience with Kafka or Spark for event-driven architecture
Utilize your data engineering skills to innovate and streamline processes in a leading IT company. #J-18808-Ljbffr
📌 Data Engineer for Global IT Company (Winnipeg)
🏢 HR Ways
📍 Winnipeg