We seek a Senior Databricks Data Engineer dedicated to designing and optimizing data pipelines. This role requires a hands-on approach, leveraging PySpark and SQL to improve data processes and architecture.

In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.

Key Responsibilities: • Develop and support real-time streaming and batch pipelines • Implement robust Medallion architectures and support BI needs • Troubleshoot and optimize Spark performance issues • Ensure data governance through Unity Catalog • Establish automated CI/CD processes for testing and deployment

Requirements: • 8+ years in Data Engineering, including 4 years in Databricks • Proficient with PySpark, Advanced SQL, and Python • Extensive experience with Delta Lake and workflows • Strong cloud integration experience (AWS, Azure, GCP) • Knowledge of dimensional modeling strategies

Channel your data engineering capabilities to enhance our data infrastructure in a rewarding setting. #J-18808-Ljbffr

📌 Expert Databricks Data Engineer Opportunity (Winnipeg)
🏢 KData AI
📍 Winnipeg