Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems.
The work supports batch, streaming, and incremental workloads at petabyte scale.Key Responsibilities: Design and operate Apache Iceberg Lakehouse platformsLead Hadoop and HDFS migration to object storageDevelop metadata, catalog, governance, and access servicesOptimize Spark performance, reliability, and cost efficiencyOperate Kubernetes workloads and resource managementRequirements: Expert knowledge of Apache Spark execution and optimizationExperience with Iceberg, Hudi, or Delta LakeHands-on Kubernetes data workload deployment experienceCloud object storage and Lakehouse architecture knowledgeThree or more years in data platform engineeringApply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ up-to-date Lakehouse platform.