Develop high-performance big data solutions using Apache Spark, Java, and distributed computing for large datasets and demanding workloads.
This Spark Developer position centers on data processing applications, pipeline development, and production performance. You will work across Spark Core, Spark SQL, DataFrames, Dataset APIs, HDFS, Hive, and Hadoop Ecosystem. Collaboration supports requirements gathering and delivery of scalable solutions.
Key Responsibilities:
- Maintain scalable applications for large-scale data processing
- Build batch and near real-time processing pipelines
- Troubleshoot production issues and recommend performance tuning
- Implement coding, testing, deployment, and monitoring practices
- Participate in reviews and technical design discussions
Requirements:
- Hands-on Apache Spark experience across core APIs
- Core Java programming experience with Java 8 or above
- Understanding of distributed data processing frameworks
- Experience with data ingestion and transformation frameworks
- Familiarity with Linux or Unix environments
Bring Spark, Java, and big data engineering skills to reliable applications, optimized pipelines, and scalable processing solutions.
📌 Big Data Spark Engineer (Mississauga)
🏢 Capgemini
📍 Mississauga
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.