Job Title: Scala Spark Developer

Location: Toronto, Ontario

Duration: Long Term Contract

HM Notes

We are looking for a Scala Spark Developer to design, develop, and optimize scalable data processing solutions supporting liquidity reporting, analytics, and data quality.

Responsibilities

- Develop and maintain data pipelines using Scala and Apache Spark.
- Build data transformations, aggregations, and calculations for reporting.
- Work with HDFS, Spark, Cassandra, and SQL in large-scale data environments.
- Integrate data from transactional, financial, risk, and other enterprise systems.
- Implement data validation, reconciliation, and error-handling processes.
- Optimize Spark jobs for performance, scalability, and reliability.
- Perform unit testing, code reviews, deployments, and production support.
- Troubleshoot data pipeline and application issues in production.




- Follow enterprise SDLC, security, governance, and development standards.

Required Skills
- Strong hands-on experience with Scala and Apache Spark.
- Strong knowledge of SQL and big data technologies.
- Experience with HDFS and distributed data processing.
- Experience with Cassandra is preferred.
- Robust understanding of data pipelines, ETL, transformations, and data quality.
- Experience working in banking, financial services, risk, or regulatory reporting is a plus.

Preferred
- Experience with liquidity reporting / MRA reporting.
- Experience with Kafka or other streaming technologies.
- Experience supporting enterprise applications in production.

📌 spark and scala developer (Toronto)
🏢 Confiar Services
📍 Toronto