Role : Azure Data Engineer with Databricks Expertise

Location : Ottawa/Toronto (Hybrid)

Contract: 06+ Months

:

Key Responsibilities:

- Data Pipeline Development:

o Build and maintain scalable ETL/ELT pipelines using Databricks.

o Leverage PySpark/Spark and SQL to transform and process large datasets.

o Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.

- Collaboration & Analysis:

o Work Closely with multiple teams to prepare data for dashboard and BI Tools.

o Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.

- Performance & Optimization:

o Optimize Databricks workloads for cost efficiency and performance.





o Monitor and troubleshoot data pipelines to ensure reliability and accuracy.

- Governance & Security:

o Implement and manage data security, access controls and governance standards using Unity Catalog.

o Ensure compliance with organizational and regulatory data policies.

- Deployment:

o Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.

o Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.

📌 Senior Data Engineer (Toronto)
🏢 Arkhya Tech.
📍 Toronto