11 Nov
|
Hyve Solutions
|
Winnipeg
11 Nov
Hyve Solutions
Winnipeg
Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads. This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale. Key Responsibilities:
Design and operate Apache Iceberg Lakehouse platforms Lead Hadoop and HDFS migration to object storage Develop metadata, catalog, governance, and access services Optimize Spark performance, reliability, and cost efficiency Operate Kubernetes workloads and resource management Requirements:
Expert knowledge of Apache Spark execution and optimization Experience with Iceberg, Hudi, or Delta Lake Hands-on Kubernetes data workload deployment experience Cloud object storage and Lakehouse architecture knowledge Three or more years in data platform engineering Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ contemporary Lakehouse platform.
📌 Senior Data Platform Engineer Lakehouse (Winnipeg)
🏢 Hyve Solutions
📍 Winnipeg