15 Nov
|
BeachHead
|
Ontario
Build scalable data solutions as a Databricks Developer using Apache Spark and advanced data engineering practices with a top financial client. This six-month contract focuses on enterprise-grade pipelines.
Design, develop, and optimise Databricks solutions across large-scale datasets and distributed computing environments. Build batch and streaming ETL with Auto Loader and Spark Structured Streaming. Apply Unity Catalog, Lakehouse Federation, SCD methodologies, and change data capture while collaborating with stakeholders on practical solution design.
Key Responsibilities: Design and optimise Databricks and Apache Spark data pipelines
Build batch and streaming ETL using Auto Loader
Maintain catalogs, schemas, tables, views, functions, and volumes
Implement SCD 1, SCD 2,
and change data capture
Apply partitioning and liquid clustering for performance
Requirements: Hands-on Databricks and Apache Spark development experience
Experience with Azure Databricks or Delta Lake
Strong Unity Catalog and Lakehouse Federation experience
Enterprise experience; banking experience preferred
Robust communication and stakeholder management skills
Apply Databricks, Spark, ETL, and governance expertise to deliver reliable enterprise data solutions for financial services.
#J-18808-Ljbffr
📌 Databricks Spark Data Engineer (Ontario)
🏢 BeachHead
📍 Ontario