06 Sep
|
HR Ways
|
Brampton
Elevate your career as a Data Engineer with a prestigious global IT firm in Brampton, Ontario. Your expertise will drive data pipelines, ETL processes, and governing data structures effectively in office. This role requires 5 to 7 years of deep experience in distributed data systems and SQL.
You will build ETL flows and manage a robust vector infrastructure including Azure AI Search and Redis. As a Data Engineer, your contributions will ensure compliance and seamless real-time processing within data pipelines. Key Responsibilities:
- Build ETL flows for structured and unstructured data
- Manage pgvector and Redis for vector indexing
- Implement zero-trust access and privacy controls
- Develop architectures for real-time data processing
- Normalize and deduplicate incoming data streams
Requirements:
- Deep experience with distributed data systems and SQL
- Proven skills in tuning high-throughput databases
- Knowledge of Google's GECX is an asset
- Familiarity with embedding models and chunking strategies
- Experience with Kafka or Spark for event-driven architecture
Utilize your data engineering skills to innovate and streamline processes in a leading IT company.
📌 Data Engineer for Global IT Company (Brampton)
🏢 HR Ways
📍 Brampton