27 Aug
|
Vsync Solutions
|
Canada
27 Aug
Vsync Solutions
Canada
We are seeking a Senior Databricks Engineer to support a high-priority, quick-tracked platform enablement initiative for a premier Canadian banking client. This role focuses on early-phase design, exploratory architecture, and moving Unity Catalog assets onto an enterprise AI platform in a regulated setting.
Key Responsibilities
Build and execute the underlying logic to migrate Unity Catalog assets (catalogs, schemas, data, views, and materialized views) onto the central enterprise AI platform.
Design and implement access patterns, Active Directory (AD) / Entra ID groups, and governance framework logic for business unit users.
Develop robust, testable Python code using pytest following standard software engineering best practices.
Execute a Proof of Concept (PoC) migrating initial pilot datasets to staging environments, laying the foundation for scaling to 100+ datasets.
Integrate data platform pipelines into automated CI/CD workflows using GitHub and Jenkins.
Required Qualifications
Tech Stack:
Advanced proficiency in Python, Databricks (specifically Unity Catalog & Delta Lake), and cloud infrastructure.
Engineering Standards: Hands-on experience with unit testing (pytest), version control (GitHub), and automated build pipelines (Jenkins CI/CD).
Domain Experience: Prior experience delivering data platform or cloud engineering solutions within Canadian Tier-1 banking or capital markets.
Platform & Infrastructure: Familiarity with cloud/ML platform orchestration, access control models, and containerized settings (Kubernetes/K8s exposure).
Location & Presence: Must be available to work on-site in Downtown Toronto.
Nice to Have
Experience with MLOps frameworks, model governance, and catalog migrations at scale.
Prior consulting experience within major professional services or enterprise IT environments.
📌 Senior Databricks Engineer Toronto (Canada)
🏢 Vsync Solutions
📍 Canada