We seek a Senior Databricks Data Engineer dedicated to designing and optimizing data pipelines. This role requires a hands-on approach, leveraging PySpark and SQL to improve data processes and architecture.

In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.

Key Responsibilities:
Develop and support real-time streaming and batch pipelines
Implement robust Medallion architectures and support BI needs
Troubleshoot and optimize Spark performance issues
Ensure data governance through Unity Catalog
Establish automated CI/CD processes for testing and deployment

Requirements:
8+ years in Data Engineering, including 4 years in Databricks
Proficient with PySpark, Advanced SQL, and Python
Extensive experience with Delta Lake and workflows
Robust cloud integration experience (AWS, Azure, GCP)
Knowledge of dimensional modeling strategies

Channel your data engineering capabilities to enhance our data infrastructure in a rewarding setting.
J-18808-Ljbffr

📌 Expert Databricks Data Engineer Opportunity Brampton
🏢 KData AI
📍 Brampton