Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.
This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze, Silver, and Gold layers while optimizing clusters hosted in Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure SQL Server.
Key Responsibilities: Design scalable ETL and ELT pipelines using Python and PySpark
Maintain Bronze, Silver, and Gold data layers
Configure Databricks clusters, workflows, and Unity Catalog governance
Optimize Azure SQL Server schemas, queries, and integrations
Establish automated quality checks and schema evolution standards




Requirements: Production experience building Azure Databricks Lakehouse solutions
Advanced Python, PySpark, Spark SQL, and Delta Lake proficiency
Hands-on Unity Catalog access control and lineage experience
Azure SQL Server modeling, normalization, and query tuning knowledge
Robust communication with business and executive stakeholders
Apply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.

#J-18808-Ljbffr

📌 Senior Azure Databricks Data Engineer (Ontario)
🏢 Recruiting In Motion - Eastern Ontario
📍 Ontario