Become a pivotal part of our team as a Senior Databricks Data Engineer focused on pipeline development and optimization. This role involves hands-on coding with PySpark and SQL, tailored for experienced data engineers ready to shape our Lakehouse platform.In this position, you'll take charge of end-to-end pipeline execution and architect solutions that support high-performance data workflows. You'll leverage your extensive experience in Databricks, focusing on building and maintaining real-time streaming pipelines, optimizing performance,



and enforcing robust data governance.Key Responsibilities:Design and maintain batch and real-time streaming pipelines using PySparkImplement Medallion Architecture for downstream BI workloadsOptimize Spark performance and troubleshoot bottlenecksEnforce data governance and automate quality checksBuild CI/CD pipelines for data solution automationRequirements:8+ years in Data Engineering, with 4+ in DatabricksMastery of PySpark, SQL, and PythonStrong experience with Delta Lake and Unity CatalogProficient in cloud integration (AWS, Azure, GCP)Solid knowledge of dimensional modeling techniquesElevate your career by applying your data engineering skills and Databricks expertise in a dynamic setting.#J-18808-Ljbffr

📌 Hands-On Databricks Engineer Role (Brampton)
🏢 KData AI
📍 Brampton