Role : Azure Data Engineer with Databricks Expertise

Location:
Ottawa/Toronto (Hybrid) Contract: 06+ Months

Job Description

Key Responsibilities
1. Data Pipeline Development: o Build and maintain scalable ETL/ELT pipelines using Databricks. o Leverage PySpark/Spark and SQL to transform and process large datasets. o Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems. 2. Collaboration & Analysis: o Work Closely with multiple teams to prepare data for dashboard and BI Tools. o Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions. 3. Performance & Optimization: o Optimize Databricks workloads for cost efficiency and performance.



o Monitor and troubleshoot data pipelines to ensure reliability and accuracy. 4. Governance & Security: o Implement and manage data security, access controls and governance standards using Unity Catalog. o Ensure compliance with organizational and regulatory data policies. 5. Deployment: o Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments. o Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.

📌 Senior Data Engineer (Toronto)
🏢 Arkhya Tech.
📍 Toronto