Elevate large-scale data processing as a Spark-Scala Big Data Developer with expertise in Hadoop/CDP. Design applications and optimize pipelines for performance efficiently. In this role, you will develop Spark-Scala applications on CDP platforms and manage Hadoop clusters.

Key responsibilities include transforming data using Spark DataFrames, writing complex HiveQL queries, and optimizing ETL/ELT pipelines. You will also work with JSON API responses, shell scripts, and automation for seamless job orchestration. Key Responsibilities:
Design and develop Spark-Scala applications for data processing
Build and optimize ETL/ELT pipelines with Spark SQL and DataFrames
Tune Spark jobs for optimal performance and efficiency




Migrate Spark 2 applications to version 3 on Cloudera CDP
Develop bash scripts for job automation and error management Requirements:
Solid experience with Spark and Hadoop/CDP clusters
Proficient in HiveQL, JSON parsing, and shell scripting
Familiarity with API integration and orchestration tools
Experience with GitHub Copilot for development acceleration
Nice to have: Cloudera CDP and HDFS encryption knowledge Utilize your data engineering expertise in a energetic role centered on Spark and Hadoop technologies.

📌 Spark Scala Big Data Developer At Cloudera Toronto (Canada)
🏢 Axiom Global Technologies
📍 Canada