19 Nov
|
Ccube
|
Mississauga
We are looking for a Senior Databricks Manager to design and lead scalable, secure, and high-performance cloud data platforms across AWS and/or Azure." Mississauga, ON (Hybrid – 3 Days Onsite Per Week) . Job Title: Databricks Data Engineering Manager – (AWS/Azure)
Location:
Mississauga, ON (Hybrid – 3 Days Onsite Per Week) Employment Type: Full-Time/CTH
Key Responsibilities
• Lead and manage Data Engineering teams responsible for building enterprise-scale data platforms using Databricks on AWS and/or Azure.
• Drive end-to-end delivery of modern data engineering solutions, including Data Lakes, Lakehouses and Data Warehouses.
• Define and implement scalable data engineering strategies, architecture standards and best practices.
• Lead the design and implementation of Medallion Architecture (Bronze, Silver and Gold layers).
• Oversee the development of robust ETL/ELT pipelines, batch processing and real-time streaming solutions.
• Ensure data platform scalability, reliability, performance optimization and cost efficiency.
• Drive engineering excellence through code reviews, CI/CD automation, DevOps practices and reusable frameworks.
• Establish data governance, data quality, security and compliance standards across data platforms.
• Collaborate with Enterprise Architects, Product Owners, Business Stakeholders and cross-functional teams.
• Manage project execution, resource allocation, delivery timelines, risks and technical dependencies.
• Mentor and develop Data Engineers,
Senior Engineers and Technical Leads.
• Drive cloud data modernization initiatives and continuous improvement across engineering processes. Must-Have Skills
• 10+ years of experience in Data Engineering, with at least 2–4 years in a Data Engineering Manager / Technical Lead / Engineering Lead role.
• Solid hands-on experience with Databricks and Apache Spark.
• Expertise in AWS and/or Azure cloud data platforms.
• Strong understanding of Data Lakes, Lakehouses, Data Warehousing and Medallion Architecture.
• Experience designing and implementing scalable ETL/ELT pipelines and data integration frameworks.
• Strong proficiency in SQL and Python/PySpark.
• Experience with Kafka, Airflow, dbt or equivalent orchestration and streaming technologies.
• Experience with structured, semi-structured and unstructured data.
• Strong understanding of Data Governance, Security, CI/CD, DevOps and data quality frameworks.
• Proven experience managing engineering teams, technical delivery and stakeholder expectations.
• Excellent leadership, communication, problem-solving and people management skills. Good to Have
· PMP, PMI-ACP, CSM or SAFe certifications.
• AWS/Azure cloud certifications.
• Databricks certifications.
• Snowflake experience.
• Experience with Data Mesh and enterprise data architecture.
• Exposure to MLOps, AI/ML data platforms and GenAI data engineering.
• Experience managing distributed engineering teams and Agile delivery models.
📌 Databricks Data Engineering Manager (Mississauga)
🏢 Ccube
📍 Mississauga