Spark Scala Developer

Mississauga, Ontario | Calgary, Alberta

Required Qualifications:

- At least 6 years of Information Technology experience

- 6+ years of experience in Big Data technologies.

- Strong expertise in:

- Apache Spark (Core, SQL, DataFrames, RDDs)

- Scala programming

- PySpark

- Hands-on experience with:

- Kafka (real-time streaming)

- Hadoop ecosystem (HDFS, Hive, Impala)

- NoSQL Databases (HBase, MongoDB, Couchbase)

- Strong understanding of distributed computing concepts and data processing frameworks.

- Experience in building ETL/data pipelines for large-scale datasets.

- Proficiency in SQL and data modeling.

Preferred Qualifications:

- Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture.

- Strong understanding and practical exposure to Agile software development methodologies (Scrum) and SDLC practices.





- Proven experience in Banking domain, supporting use cases such as fraud detection, risk analytics, regulatory reporting, and customer insights.

- Excellent analytical, problem-solving, and communication skills, with the ability to translate business requirements into scalable technical solutions.

- Demonstrated ability to work effectively in cross-functional, multi-stakeholder environments, collaborating with Business, Data Engineering, and Architecture teams.

- Experience with real-time data streaming frameworks such as Kafka and Spark Streaming for low-latency processing.

- Understanding data modeling concepts (dimensional modeling, snowflake schemas) to support analytics workloads.

- Experience and desire to work in a global delivery workplace.

📌 Spark Scala Developer (Ontario)
🏢 Avance Consulting
📍 Ontario