We seek a Senior Databricks Data Engineer dedicated to designing and optimizing data pipelines. This role requires a hands-on approach, leveraging PySpark and SQL to improve data processes and architecture.
In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.
Key Responsibilities:
• Develop and support real-time streaming and batch pipelines
• Implement robust Medallion architectures and support BI needs
• Troubleshoot and optimize Spark performance issues
• Ensure data governance through Unity Catalog
• Establish automated CI/CD processes for testing and deployment
Requirements:
• 8+ years in Data Engineering, including 4 years in Databricks
• Proficient with PySpark, Advanced SQL, and Python
• Extensive experience with Delta Lake and workflows
• Solid cloud integration experience (AWS, Azure, GCP)
• Knowledge of dimensional modeling strategies
Channel your data engineering capabilities to enhance our data infrastructure in a rewarding environment.
#J-18808-Ljbffr

📌 Expert Databricks Data Engineer Opportunity (Brampton)
🏢 KData AI
📍 Brampton