Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.

This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze, Silver, and Gold layers while optimizing clusters hosted in Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure SQL Server.

Key Responsibilities

Design scalable ETL and ELT pipelines using Python and PySpark

Maintain Bronze, Silver, and Gold data layers

Configure Databricks clusters, workflows, and Unity Catalog governance

Optimize Azure SQL Server schemas, queries, and integrations

Establish automated quality checks and schema evolution standards

Requirements

Production experience building Azure Databricks Lakehouse solutions

Advanced Python, PySpark, Spark SQL, and Delta Lake proficiency

Hands-on Unity Catalog access control and lineage experience

Azure SQL Server modeling, normalization, and query tuning knowledge

Robust communication with business and executive stakeholders

Apply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.

📌 Senior Azure Databricks Data Engineer (Winnipeg)
🏢 Recruiting In Motion - Eastern Ontario
📍 Winnipeg