Join us as a Senior Databricks Data Engineer, where you will actively engage in developing cutting-edge data solutions. This position emphasizes hands-on experience with pipeline creation using PySpark, SQL, and modern data architecture.

You’ll be responsible for executing comprehensive data pipelines and contribute to enhancing our Lakehouse platform's infrastructure. This role demands a strong ability in optimizing databricks clusters and maintaining data quality, ensuring reliable and performant data workflows.

Key Responsibilities:
• Build enterprise-scale batch and streaming pipelines in PySpark
• Refine Medallion Architecture for productive BI configurations
• Diagnose Spark performance issues and implement solutions




• Automate compliance with data governance policies
• Create and manage CI/CD pipelines for deployments

Requirements:
• Minimum 8 years in Data Engineering; 4 in Databricks
• Expert in PySpark and Advanced SQL
• In-depth knowledge of Delta Lake constructs
• Familiar with cloud infrastructure (AWS, Azure, GCP)
• Understanding of data modeling frameworks

Utilize your expertise in a challenging role designed for advanced data engineers looking to make an impact.
#J-18808-Ljbffr

📌 Senior Data Engineer with Databricks Focus (Ontario)
🏢 KData AI
📍 Ontario