Lead Data Engineer – Databricks (Toronto)

Lead Data Engineer – Databricks (Toronto)

22 Sep
|
TEEMA
|
Toronto

22 Sep

TEEMA

Toronto

Job Title

Team Lead, Data Engineering – Databricks

Job ID

86747

Location

Toronto, Ontario

Overview

Our client has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.

As a Team Lead, you will?lead a technical team?of 3-5 data engineers, ensuring best practices in performance, security, and scalability while working on an enterprise wide Centralized Data Platform (CDP) built on Databricks. This role requires a deep, hands‑on understanding of Databricks internals and a track record of?delivering large-scale data platforms in a cloud setting.

What you will be doing:

You will lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locations

Drive the Agile/Scrum SDLC process and collaborate with team members

Design and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics

Develop and optimize ETL/ELT pipelines

Create and manage structured streaming pipelines for real‑time data processing

Configure and optimize Databricks clusters and Spark jobs for optimal performance

Utilize Delta Live Tables for data ingestion and transformations

Apply Unity Catalog features and IAM best practices for security governance and access control

Support infrastructure and resource management using Terraform

Implement monitoring solutions for pipeline performance and data quality

Contribute to code reviews and knowledge‑sharing sessions

What you must have

8+ years of experience in data engineering

3+ years of hands‑on experience with Databricks platform





Proven experience leading a team

Strong expertise in Python and Spark programming

Demonstrable experience in using AI in development

Proven experience with AWS or other similar cloud services

Deep understanding of data modeling and SQL

Experience with Delta Lake and Lakehouse architecture

Strong knowledge of ETL/ELT principles and patterns

Experience with version control systems (Git)

Demonstrated ability to optimize data pipelines

Strong problem‑solving and analytical skills

Excellent communication and collaboration abilities

Nice to have

Financial services industry experience

Experience with multiple cloud providers

Knowledge of AI/ML implementation patterns

API development experience

Experience with real‑time data processing

Data governance framework experience

What Sets You Apart

Active interest in emerging technologies and industry trends

Experience implementing complex data solutions

Track record of continuous learning and skill development

Strong technical documentation abilities

Experience using AI tools to enhance productivity

Ability to mentor junior team members

Technical Environment

Primary Platform: Databricks

Cloud Platform: AWS (S3, Glue, Lambda)

Languages: Python, SQL

Tools: Delta Lake, Unity Catalog, Git

Additional: Real‑time processing, API integrations

Salary/Rate Range

CAD $135,000 – CAD $175,000

Other Information

Hybrid – 3 days/week onsite downtown Toronto

40 hour work week

Thank you for your interest in this opportunity. If you are selected to move forward in the process, we will contact you directly. If you do not hear from us, we encourage you to continue visiting our website for other roles that may be a good fit.

For more information about TEEMA and to consider other career opportunities, please visit our website at www.teemagroup.co

📌 Lead Data Engineer – Databricks (Toronto)
🏢 TEEMA
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer – databricks (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: lead data engineer – databricks (toronto) / toronto