Join us as a Senior Databricks Data Engineer, where you will actively engage in developing cutting-edge data solutions. This position emphasizes hands-on experience with pipeline creation using PySpark, SQL, and up-to-date data architecture.

You’ll be responsible for executing comprehensive data pipelines and contribute to enhancing our Lakehouse platform's infrastructure. This role demands a strong ability in optimizing databricks clusters and maintaining data quality, ensuring reliable and performant data workflows.

Key Responsibilities: • Build enterprise-scale batch and streaming pipelines in PySpark • Refine Medallion Architecture for efficient BI configurations • Diagnose Spark performance issues and implement solutions • Automate compliance with data governance policies • Create and manage CI/CD pipelines for deployments

Requirements: • Minimum 8 years in Data Engineering; 4 in Databricks • Expert in PySpark and Advanced SQL • In-depth knowledge of Delta Lake constructs • Familiar with cloud infrastructure (AWS, Azure, GCP) • Understanding of data modeling frameworks

Utilize your expertise in a challenging role designed for advanced data engineers looking to make an impact. #J-18808-Ljbffr

📌 Senior Data Engineer with Databricks Focus (Winnipeg)
🏢 KData AI
📍 Winnipeg