Spark Scala Developer

Mississauga, Ontario | Calgary, Alberta

Required Qualifications:
At least 6 years of Information Technology experience
6+ years of experience in Big Data technologies.
Solid expertise in:
Apache Spark (Core, SQL, DataFrames, RDDs)
Scala programming
PySpark
Hands-on experience with:
Kafka (real-time streaming)
Hadoop ecosystem (HDFS, Hive, Impala)
NoSQL Databases (HBase, MongoDB, Couchbase)
Strong understanding of distributed computing concepts and data processing frameworks.
Experience in building ETL/data pipelines for large-scale datasets.
Proficiency in SQL and data modeling.

Preferred Qualifications:
Hands-on experience with data lakes, data warehouses, and scalable ETL pipeline design, including batch and real-time processing architecture.
Strong understanding and practical exposure to Agile software development methodologies (Scrum) and SDLC practices.




Proven experience in Banking domain, supporting use cases such as fraud detection, risk analytics, regulatory reporting, and customer insights.
Excellent analytical, problem-solving, and communication skills, with the ability to translate business requirements into scalable technical solutions.
Demonstrated ability to work effectively in cross-functional, multi-stakeholder settings, collaborating with Business, Data Engineering, and Architecture teams.
Experience with real-time data streaming frameworks such as Kafka and Spark Streaming for low-latency processing.
Understanding data modeling concepts (dimensional modeling, snowflake schemas) to support analytics workloads.
Experience and desire to work in a global delivery workplace.

📌 Spark Scala Developer Ontario
🏢 Avance Consulting
📍 Ontario