15 Nov
|
Hyve Solutions
|
Winnipeg
15 Nov
Hyve Solutions
Winnipeg
Apache Iceberg, Spark, and object storage are central to this Data Warehouse System Engineer position at Hyve Solutions. Build enterprise Lakehouse capabilities. As an experienced Data Platform Engineer, you will modernize traditional Hadoop and Hive architecture into a cloud-native platform. Your focus is platform engineering, including metadata, catalogs, governance, and unified access across processing engines. You will address scalability, concurrency, performance, and operational stability in petabyte-scale environments. Key Responsibilities:
Build Lakehouse services supporting batch and streaming workloads Implement compute-storage separation at enterprise scale Enable access through Spark, Flink, and Trino Integrate Azure, Databricks,
and Snowflake ecosystems Create ingestion, orchestration, quality, and diagnostic tools Requirements:
Deep understanding of Iceberg metadata and snapshots Experience with Spark, Kubernetes, and resource scheduling Knowledge of Azure Blob, Amazon S3, or MinIO Programming skills in Java, Scala, or Python Bachelor’s or Master’s degree in a technical field Use Apache Iceberg, Spark, cloud storage, and platform engineering skills to advance Hyve Solutions’ enterprise data architecture.
#J-18808-Ljbffr
📌 Apache Iceberg Platform Engineer (Winnipeg)
🏢 Hyve Solutions
📍 Winnipeg