Become a pivotal part of our team as a Senior Databricks Data Engineer focused on pipeline development and optimization. This role involves hands-on coding with PySpark and SQL, tailored for experienced data engineers ready to shape our Lakehouse platform.

In this position, you'll take charge of end-to-end pipeline execution and architect solutions that support high-performance data workflows. You'll leverage your extensive experience in Databricks, focusing on building and maintaining real-time streaming pipelines, optimizing performance, and enforcing robust data governance.

Key Responsibilities:
• Design and maintain batch and real-time streaming pipelines using PySpark
• Implement Medallion Architecture for downstream BI workloads




• Optimize Spark performance and troubleshoot bottlenecks
• Enforce data governance and automate quality checks
• Build CI/CD pipelines for data solution automation

Requirements:
• 8+ years in Data Engineering, with 4+ in Databricks
• Mastery of PySpark, SQL, and Python
• Strong experience with Delta Lake and Unity Catalog
• Proficient in cloud integration (AWS, Azure, GCP)
• Solid knowledge of dimensional modeling techniques

Elevate your career by applying your data engineering skills and Databricks expertise in a dynamic workplace.
#J-18808-Ljbffr

📌 Hands-On Databricks Engineer Role (Ontario)
🏢 KData AI
📍 Ontario