Join us as a Senior Databricks Data Engineer, where you will actively engage in developing cutting-edge data solutions. This position emphasizes hands-on experience with pipeline creation using PySpark, SQL, and up-to-date data architecture.You'll be responsible for executing comprehensive data pipelines and contribute to enhancing our Lakehouse platform's infrastructure. This role demands a strong ability in optimizing databricks clusters and maintaining data quality, ensuring reliable and performant data workflows.Key Responsibilities:Build enterprise-scale batch and streaming pipelines in PySparkRefine Medallion Architecture for efficient BI configurationsDiagnose Spark performance issues and implement solutionsAutomate compliance with data governance policiesCreate and manage CI/CD pipelines for deploymentsRequirements:Minimum 8 years in Data Engineering; 4 in DatabricksExpert in PySpark and Advanced SQLIn-depth knowledge of Delta Lake constructsFamiliar with cloud infrastructure (AWS, Azure, GCP)Understanding of data modeling frameworksUtilize your expertise in a challenging role designed for advanced data engineers looking to make an impact.#J-18808-Ljbffr

📌 Senior Data Engineer With Databricks Focus (Brampton)
🏢 KData AI
📍 Brampton