Become a pivotal part of our team as a Senior Databricks Data Engineer focused on pipeline development and optimization. This role involves hands-on coding with PySpark and SQL, tailored for experienced data engineers ready to shape our Lakehouse platform.

In this position, you'll take charge of end-to-end pipeline execution and architect solutions that support high-performance data workflows. You'll leverage your extensive experience in Databricks, focusing on building and maintaining real-time streaming pipelines, optimizing performance, and enforcing robust data governance.

Key Responsibilities:
Design and maintain batch and real-time streaming pipelines using PySpark
Implement Medallion Architecture for downstream BI workloads




Optimize Spark performance and troubleshoot bottlenecks
Enforce data governance and automate quality checks
Build CI/CD pipelines for data solution automation

Requirements:
8+ years in Data Engineering, with 4+ in Databricks
Mastery of PySpark, SQL, and Python
Robust experience with Delta Lake and Unity Catalog
Proficient in cloud integration (AWS, Azure, GCP)
Solid knowledge of dimensional modeling techniques

Elevate your career by applying your data engineering skills and Databricks expertise in a energetic workplace.
J-18808-Ljbffr

📌 Hands On Databricks Engineer Role Brampton (Canada)
🏢 KData AI
📍 Canada