16 Sep
|
VySystems
|
Toronto
Responsibilities
- Define the Azure Databricks Lakehouse architecture and create a comprehensive migration roadmap.
- Design and implement Medallion Architecture (Bronze, Silver, Gold) and Delta Lake solutions.
- Lead the architecture for the BigQuery-to-Databricks migration, including source-to-target mapping.
- Establish governance, security, and data management standards utilizing Unity Catalog.
- Architect scalable data models, ingestion frameworks, and analytics platforms to support business needs.
- Collaborate with business, engineering, and program teams to deliver cloud modernization initiatives effectively.
Mandatory Skills
- Expertise in Azure Databricks, including Delta Lake and Lakehouse Architecture.
- Proficient in PySpark and SQL.
- Solid background in Data Modeling (Dimensional/Data Vault),
Data Migration, and Modernization.
- Experience with Azure Data Factory and ADLS Gen2.
- Familiarity with CI/CD processes and Azure DevOps.
- Proven experience in delivering large-scale cloud data migration programs.
Preferred Skills
- Experience with BigQuery migration.
- Financial Services industry experience is preferred.
Qualifications
- 15+ years of experience in Data & Analytics.
- 5+ years of experience in Data Architecture.
- Preferred certifications include:
- Microsoft Azure Solutions Architect Expert
- Databricks Certified Professional
- TOGAF
📌 Data Architect (Toronto)
🏢 VySystems
📍 Toronto