Join us as a Senior Databricks Data Engineer, where you will actively engage in developing cutting-edge data solutions. This position emphasizes hands-on experience with pipeline creation using PySpark, SQL, and modern data architecture.

You’ll be responsible for executing comprehensive data pipelines and contribute to enhancing our Lakehouse platform's infrastructure. This role demands a robust ability in optimizing databricks clusters and maintaining data quality, ensuring reliable and performant data workflows.

Key Responsibilities:

- Build enterprise-scale batch and streaming pipelines in PySpark
- Refine Medallion Architecture for efficient BI configurations
- Diagnose Spark performance issues and implement solutions
- Automate compliance with data governance policies
- Create and manage CI/CD pipelines for deployments

Requirements:

- Minimum 8 years in Data Engineering; 4 in Databricks
- Expert in PySpark and Advanced SQL
- In-depth knowledge of Delta Lake constructs
- Familiar with cloud infrastructure (AWS, Azure, GCP)
- Understanding of data modeling frameworks

Utilize your expertise in a challenging role designed for advanced data engineers looking to make an impact.

#J-18808-Ljbffr

📌 Senior Data Engineer with Databricks Focus (Brampton)
🏢 KData AI
📍 Brampton