Location: Toronto, ON - Hybrid - (Thursday and 4th Friday of the month - may change due to business requirements)
Pay Rate: $89.88/hr -$103.89/hr
Contract Length: 6 Months with possibility for extension
We at Raise are hiring a Data Analyst - Expert for one of our top clients. After establishing themselves as an industry leader, they’re now expanding their team to meet rising demand. We’re hiring right now; if you’re interested, for your chance to join a outstanding place to work
Responsibilities
Develop and maintain ADF pipelines and Databricks solutions.
Build Python notebooks using Spark and implement Medallion Architecture.
Configure Unity Catalog, data governance, security, and permissions.
Migrate Hive Metastore to Unity Catalog.
Design and manage Delta Lake tables and schemas.
Implement CI/CD pipelines using Azure DevOps or GitHub Enterprise.
Manage Azure resources, Entra ID, SSO, and RBAC.
Monitor pipelines and optimize performance and costs.
Troubleshoot technical issues and lead a small team.
Skills
7+ Years experience with ADF, Databricks and Azure Functions (C#)
In depth development experience python/notebook on Databricks/Spark/panda
Expert working knowledge of Unity Catalog and data governance setup/configuration
Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
Creating delta table schema/tables with proper design/properties & security permissions
DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
In depth experience on Azure Entra ID for SSO/RBAC setup
In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
Familiar to work in lock down windows environment for highly regulated industry
Ability to work independently and lead a small team.
Proven ability to work independently with minimum supervision
Ability to lead a small team and technical problem-solving sessions
Excellent Communication skills
Financial Services Industry experience is an Asset.
Must Have Requirements
10+ total experience but for Databricks can be 5-8 years experience.
ADF orchestrations with Databricks
Experience with set up and configuration of data governance