Develop high-performance big data solutions using Apache Spark, Java, and distributed computing for large datasets and demanding workloads.
This Spark Developer position centers on data processing applications, pipeline development, and production performance. You will work across Spark Core, Spark SQL, DataFrames, Dataset APIs, HDFS, Hive, and Hadoop Ecosystem. Collaboration supports requirements gathering and delivery of scalable solutions.
Key Responsibilities:
Maintain scalable applications for large-scale data processing
Build batch and near real-time processing pipelines
Troubleshoot production issues and recommend performance tuning
Implement coding, testing, deployment, and monitoring practices
Participate in reviews and technical design discussions
Requirements:
Hands-on Apache Spark experience across core APIs
Core Java programming experience with Java 8 or above
Understanding of distributed data processing frameworks
Experience with data ingestion and transformation frameworks
Familiarity with Linux or Unix settings
Bring Spark, Java, and big data engineering skills to reliable applications, optimized pipelines, and scalable processing solutions.
📌 Big Data Spark Engineer Mississauga
🏢 Capgemini
📍 Mississauga
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.