Apache Iceberg and Spark define this Data Platform Engineer prospect at Hyve Solutions. Build cloud-native data infrastructure at PB scale.

This experienced Data Warehouse SE will evolve Hyve’s enterprise platform from Hadoop and Hive toward a Lakehouse architecture. The work emphasizes platform engineering, distributed data systems, Kubernetes, object storage, and large-scale processing. You will support batch, streaming, and incremental workloads while developing core platform capabilities.

Key Responsibilities:

- Design and operate an Apache Iceberg Lakehouse platform
- Migrate Hadoop and HDFS to cloud-native object storage
- Develop metadata, catalog, governance, and multi-engine access services
- Optimize Spark performance, scalability, reliability, and cost efficiency




- Operate Kubernetes data platforms and integrate Azure, Databricks, and Snowflake

Requirements:

- Expert knowledge of Apache Spark execution and optimization
- Strong Apache Iceberg, Hudi, or Delta Lake experience
- Hands-on Kubernetes and Spark on Kubernetes experience
- Cloud object storage knowledge and distributed systems expertise
- At least three years in large-scale data platform engineering

Apply your Spark, Iceberg, Kubernetes, and cloud-native platform expertise to Hyve Solutions’ enterprise data evolution.

📌 Data Platform Engineer Apache Iceberg (Canada)
🏢 Hyve Solutions
📍 Canada