Are you a seasoned Data Analyst with expert-level skills in Azure and Databricks?Working with one of our top financial clients, this role calls for an Azure Data Engineer-Databricks /ADF. This position involves working within a transformative data environment focused on advancing Databricks functionality and supporting large-scale investment transaction processes for institutional clients.Pay rate range (CAD): $86.96/hr – $104.35/hrResponsibilities:Develop and maintain pipelines using Azure Data Factory (ADF), Databricks, and Azure Functions (C#)Build and optimize Spark/Pandas notebooks for data processing and analysisConfigure and manage Unity Catalog for data governance and security in DatabricksMigrate Databricks workspace from hive metastore to Unity Catalog, handling permissions and security configurationsDesign delta tables with proper schema, properties, and security controlsImplement Delta Live Tables and related features to enhance data workflows (nice to have)Manage DevOps and deployment pipelines using Azure DevOps and GitHub Enterprise for both ADF and DatabricksWork with Azure Entra ID for SSO and RBAC setupDeploy and manage Azure PaaS resources such as Azure SQL, ADF/SHIR, ADLS, and Synapse SQL databasesCollaborate with a team of Data Engineers, Business Analysts, and Project Managers to meet project goalsWork independently and lead small technical team sessions to troubleshoot and resolve issuesEnsure compliance with data governance and security standards for highly regulated environmentsDesired Skill-Set:7+ years of experience with ADF, Databricks,



Azure Functions (C#)Extensive development experience with Python/notebooks on Databricks/Spark/PandasExpert knowledge of Unity Catalog and data governance setupExperience loading datasets from various sources using ADF with Medallion architectureProven track record migrating Databricks from hive metastore to Unity Catalog and managing permissionsAbility to design delta tables with security considerationsStrong DevOps skills using Azure DevOps and GitHub EnterpriseIn-depth experience with Azure Entra ID for SSO/RBACProficiency working with Azure SQL PaaS, ADLS, Synapse, and other Azure servicesFamiliarity with working in a highly regulated environmentAbility to work independently, lead a team, and solve complex technical problemsFinancial services industry experience (asset)Excellent communication skillsNice to Have:Previous experience working with financial institutionsKnowledge of Delta Live TablesExperience with Azure Synapse AnalyticsFamiliarity with Windows environments in regulated industriesBeachHead is an equal chance agency and employer.We advocate for our candidates and welcome applicants regardless of race, color, religion, national origin, sex, age, or physical or mental disability.BeachHead or our clients may use technology-enabled tools, including automation and artificial intelligence (AI), to support parts of the recruitment process such as resume screening, application management, and candidate matching.These tools assist our recruiters and our clients, and do not replace human decision-making.This job posting represents a current or anticipated vacancy.The position may be filled at any time, and the posting may be removed without notice once the role has been filled. #J-18808-Ljbffr

📌 Azure Data Engineer-Databricks /Adf (Toronto)
🏢 BeachHead
📍 Toronto