27 Aug
|
TEEMA
|
Winnipeg
Job Title:Team Lead, Data Engineering – DatabricksJob ID:86747Location:Toronto, OntarioOverview:Our client has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.What you will be doing:You will lead and mentor a team of data engineers, conducting code reviews, design reviews, and knowledge-sharing sessions across multiple locationsDrive the Agile/Scrum SDLC process and collaborate with team membersDesign and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analyticsDevelop and optimize ETL/ELT pipelinesCreate and manage structured streaming pipelines for real-time data processingConfigure and optimize Databricks clusters and Spark jobs for optimal performanceUtilize Delta Live Tables for data ingestion and transformationsApply Unity Catalog features and IAM best practices for security governance and access controlSupport infrastructure and resource management using TerraformImplement monitoring solutions for pipeline performance and data qualityContribute to code reviews and knowledge-sharing sessionsWhat you must have:8+ years of experience in data engineering3+ years of hands-on experience with Databricks platformProven experience leading a teamStrong expertise in Python and Spark programmingDemonstrable experience in using AI in developmentProven experience with AWS or other similar cloud servicesDeep understanding of data modeling and SQLExperience with Delta Lake and Lakehouse architectureStrong knowledge of ETL/ELT principles and patternsExperience with version control systems (Git)Demonstrated ability to optimize data pipelinesStrong problem-solving and analytical skillsExcellent communication and collaboration abilitiesNice to have:Financial services industry experienceExperience with multiple cloud providersKnowledge of AI/ML implementation patternsAPI development experienceExperience with real-time data processingData governance framework experienceWhat Sets You ApartActive interest in emerging technologies and industry trendsExperience implementing complex data solutionsTrack record of continuous learning and skill developmentStrong technical documentation abilitiesExperience using AI tools to enhance productivityAbility to mentor junior team membersTechnical EnvironmentPrimary Platform: DatabricksCloud Platform: AWS (S3, Glue, Lambda)Languages: Python, SQLTools: Delta Lake, Unity Catalog, GitAdditional: Real-time processing, API integrationsSalary/Rate Range:CAD $135,000 – CAD $175,000Other InformationHybrid – 3 days/week onsite downtown Toronto40 hour work weekThank you for your interest in this opportunity. If you are selected to move forward in the process, we will contact you directly. If you do not hear from us, we encourage you to continue visiting our website for other roles that may be a valuable fit.For more information about TEEMA and to consider other career opportunities, please visit our website at www.Teemagroup.Co#J-18808-Ljbffr
📌 Lead Data Engineer – Databricks - C$135,000 - C$175,000 A Year (Winnipeg)
🏢 TEEMA
📍 Winnipeg