Data Analyst - ADF, Databricks and Azure #107546
Request ID: 107546-1
Start/End Dates: ASAP for 6 ,omths
Work Location: downtown Toronto, near TTC and GO
Job Title: IT - Data Analyst - Expert
Line of Business: Global Asset Management Technology
Target rate range: $90-100hr B2B
Target Start Date: ASAP
Duration: 6 months
Potential for this contract to be extended or converted to FTE? Extension: Yes / FTE: Yes
Hybrid work: in office on Thursday, plus 4th Friday of the month. (occasional additional days if needed - changes coming based on business need)
Office Location: 81 Bay Street, Toronto
Work Schedule (hours per week, start time): 37.5 Hours/week, 9-5 Monday to Friday
Potential for OT? No
What does the LOB do?
Global Asset Management institutional execution is the process by which asset managers carry out large-scale investment transactions on behalf of institutional clients. This involves optimizing trade strategies, ensuring best pricing, minimizing market impact, and adhering to regulatory requirements to achieve efficient and secure execution of investment decisions.
Highlights of the role; why would someone choose this role over another?
Business is under transformation journey and open to explore advance functionality of databricks.
Who Will the Candidate Be Working with on a Daily Basis?
Data Engineer Lead + BAs
How many years of experience?: 10+
Job Description
7+ Years experience with ADF, Databricks and Azure Functions (C#)
In depth development experience python/notebook on Databricks/Spark/panda
Expert working knowledge of Unity Catalog and data governance setup/configuration
Experience in loading datasets from various sources using ADF to Databricks with Medallion architecture
Experience on converting Databricks workspace from hive metastore to unity catalog & setup associated permissions
Creating delta table schema/tables with proper design/properties & security permissions
Nice to have experience on Delta Live Table.
DevOps & deployment pipeline using Azure DevOps/GitHub Enterprise for both ADF and databricks
In depth experience on Azure Entra ID for SSO/RBAC setup
In depth experience on working with/deploying to Azure PaaS resources such as Azure SQL PaaS, ADF/SHIR, ADLS, Databricks, Synapse dedicated SQL databases
Familiar to work in lock down windows workplace for highly regulated industry
Ability to work independently and lead a small team.
Proven ability to work independently with minimum supervision
Ability to lead a small team and technical problem-solving sessions
Financial Services Industry experience is an Asset.