05 Sep
|
HR Ways
|
Ontario
Elevate your career as a Data Engineer with a prestigious global IT firm in Brampton, Ontario. Your expertise will drive data pipelines, ETL processes, and governing data structures effectively in office.
This role requires 5 to 7 years of deep experience in distributed data systems and SQL. You will build ETL flows and manage a robust vector infrastructure including Azure AI Search and Redis. As a Data Engineer, your contributions will ensure compliance and seamless real-time processing within data pipelines.
Key Responsibilities:
• Build ETL flows for structured and unstructured data
• Manage pgvector and Redis for vector indexing
• Implement zero-trust access and privacy controls
• Develop architectures for real-time data processing
• Normalize and deduplicate incoming data streams
Requirements:
• Deep experience with distributed data systems and SQL
• Proven skills in tuning high-throughput databases
• Knowledge of Google's GECX is an asset
• Familiarity with embedding models and chunking strategies
• Experience with Kafka or Spark for event-driven architecture
Utilize your data engineering skills to innovate and streamline processes in a leading IT company.
#J-18808-Ljbffr
📌 Data Engineer for Global IT Company (Ontario)
🏢 HR Ways
📍 Ontario