16 Nov
|
Hyve Solutions
|
Winnipeg
16 Nov
Hyve Solutions
Winnipeg
Apache Iceberg, Spark, and object storage are central to this Data Warehouse System Engineer position at Hyve Solutions. Build enterprise Lakehouse capabilities.
As an experienced Data Platform Engineer, you will modernize traditional Hadoop and Hive architecture into a cloud-native platform. Your focus is platform engineering, including metadata, catalogs, governance, and unified access across processing engines. You will address scalability, concurrency, performance, and operational stability in petabyte-scale environments.
Key Responsibilities
Build Lakehouse services supporting batch and streaming workloads
Implement compute-storage separation at enterprise scale
Enable access through Spark, Flink, and Trino
Integrate Azure, Databricks,
and Snowflake ecosystems
Create ingestion, orchestration, quality, and diagnostic tools
Requirements
Deep understanding of Iceberg metadata and snapshots
Experience with Spark, Kubernetes, and resource scheduling
Knowledge of Azure Blob, Amazon S3, or MinIO
Programming skills in Java, Scala, or Python
Bachelor’s or Master’s degree in a technical field
Use Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
📌 Apache Iceberg Platform Engineer (Winnipeg)
🏢 Hyve Solutions
📍 Winnipeg