Senior Azure Databricks Engineer (Contract)

Location: Calgary, AB (Onsite 4 days/week – downtown)

Term: 3–6 months

Engagement: Contract through a consulting firm delivering data engineering projects for multiple enterprise clients Industry: Oil & Gas (experience a plus, not required)

A leading Canadian consulting firm is seeking an experienced Databricks Engineer to support several high-impact client initiatives. This is a hands-on engineering role focused on designing, building, and optimizing data workloads on Azure Databricks, including large-scale migrations, platform modernization, and AI/ML enablement.

You will work directly with consulting delivery teams and enterprise client stakeholders in a fast-moving, collaborative workplace. This role requires Calgary-based candidates who are comfortable being onsite 4 days per week.

Key Responsibilities

- Design and develop Azure Databricks solutions using PySpark and SQL
- Build and optimize batch and streaming data pipelines
- Migrate legacy workloads from Synapse and other platforms into Databricks
- Implement Delta Lake patterns (medallion architecture, CDC, data quality)
- Integrate Databricks with Azure services such as ADLS, ADF, Azure Key Vault, and Azure DevOps/GitHub
- Optimize performance and cost (cluster sizing, job orchestration, query tuning)
- Collaborate with architects, analytics engineers, and client teams
- Contribute to reusable accelerators, internal standards, and best practices
- Support client enablement through documentation and knowledge transfer
- Implement governance models and Unity Catalog (access controls, lineage, security frameworks)

Required Skills & Experience





- 7 years of data engineering experience
- 4 years of recent, hands-on Databricks engineering (Delta Lake, Unity Catalog, MLflow)
- Strong experience building production pipelines using PySpark and SQL
- Proven experience with Azure data services: ADLS, ADF, Synapse, Key Vault, Azure DevOps
- Experience leading large-scale data migrations and ETL/ELT workload modernization
- Strong understanding of lakehouse architecture, medallion patterns, and modern ELT/ETL approaches
- Experience implementing CI/CD for data workloads
- Strong understanding of enterprise data governance, security, and compliance
- Excellent communication skills with comfort working directly with client teams
- Previous consulting or professional services experience strongly preferred
- Databricks and Azure certifications considered an asset

Ideal Candidate Profile A strong, hands-on Azure Databricks engineer who:

- Delivers high-quality, production-ready code
- Understands modern data architecture and platform design
- Communicates clearly with technical and non-technical stakeholders
- Thrives in collaborative, client-facing environments
- Is comfortable being onsite 4 days/week
- Can contribute immediately to high-impact migration and modernization projects

Why This Role Stands Out

- Contract through a delivery-focused consulting firm supporting multiple enterprise clients
- Work on high-impact Oil & Gas data initiatives (migration, modernization, AI/ML enablement)
- Exposure to advanced Databricks features and architecture patterns

Only qualified candidates will be contacted for next steps. Thank you in advance for your interest.

📌 Senior Azure Databricks Engineer (4 days onsite - Calgary)
🏢 Hire DigITalent
📍 Calgary