We seek a Senior Databricks Data Engineer dedicated to designing and optimizing data pipelines. This role requires a hands-on approach, leveraging PySpark and SQL to improve data processes and architecture.In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.Key Responsibilities:Develop and support real-time streaming and batch pipelinesImplement robust Medallion architectures and support BI needsTroubleshoot and optimize Spark performance issuesEnsure data governance through Unity CatalogEstablish automated CI/CD processes for testing and deploymentRequirements:8+ years in Data Engineering, including 4 years in DatabricksProficient with PySpark, Advanced SQL, and PythonExtensive experience with Delta Lake and workflowsStrong cloud integration experience (AWS, Azure, GCP)Knowledge of dimensional modeling strategiesChannel your data engineering capabilities to enhance our data infrastructure in a rewarding setting.#J-18808-Ljbffr

📌 Expert Databricks Data Engineer Opportunity (Brampton)
🏢 KData AI
📍 Brampton