11 Nov
|
Hyve Solutions
|
Manitoba
11 Nov
Hyve Solutions
Manitoba
Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.
This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale.
Key Responsibilities: Design and operate Apache Iceberg Lakehouse platforms
Lead Hadoop and HDFS migration to object storage
Develop metadata, catalog, governance, and access services
Optimize Spark performance, reliability, and cost efficiency
Operate Kubernetes workloads and resource management
Requirements: Expert knowledge of Apache Spark execution and optimization
Experience with Iceberg, Hudi, or Delta Lake
Hands-on Kubernetes data workload deployment experience
Cloud object storage and Lakehouse architecture knowledge
Three or more years in data platform engineering
Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ up-to-date Lakehouse platform.
#J-18808-Ljbffr
📌 Senior Data Platform Engineer Lakehouse (Manitoba)
🏢 Hyve Solutions
📍 Manitoba