Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.

This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale.

Key Responsibilities:

- Design and operate Apache Iceberg Lakehouse platforms
- Lead Hadoop and HDFS migration to object storage
- Develop metadata, catalog, governance, and access services
- Optimize Spark performance, reliability, and cost efficiency
- Operate Kubernetes workloads and resource management

Requirements:

- Expert knowledge of Apache Spark execution and optimization
- Experience with Iceberg, Hudi, or Delta Lake
- Hands-on Kubernetes data workload deployment experience
- Cloud object storage and Lakehouse architecture knowledge
- Three or more years in data platform engineering

Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ contemporary Lakehouse platform.

📌 Senior Data Platform Engineer Lakehouse (Canada)
🏢 Hyve Solutions
📍 Canada