Senior Azure Databricks Engineer (Canada)

Senior Azure Databricks Engineer (Canada)

04 Nov
|
Lumenalta
|
Canada

04 Nov

Lumenalta

Canada

About Lumenalta At Lumenalta, we partner with forward-thinking organizations to build technology solutions that scale, delight users, and accelerate business growth. Our global teams bring curiosity, commitment, and technical excellence to every project. We value transparency, autonomy, and impact, empowering every team member to do their best work.

About the Role
We are looking for a Senior Azure Databricks Engineer to lead the design and delivery of modern enterprise data platforms for our clients. In this role, you will own the architecture and implementation of lakehouse platforms on Databricks and Azure, from governance and infrastructure to pipelines and production operations. You will set the technical direction for the platform, establish the standards the rest of the team builds on, and serve as the trusted technical voice for client stakeholders. This is a hands-on role for an engineer who brings software engineering discipline to data platform work and who wants real ownership of what gets built. What You'll Be Doing
• Platform architecture and ownership. Lead end-to-end architecture for enterprise lakehouse platforms on Databricks and Azure, owning design decisions across storage, compute, governance, security, and cost, and documenting them so they hold up as the platform grows.
• Governance and security. Design and implement Unity Catalog strategies, including catalog and schema structure, access control models, lineage and data sharing, aligned with client security and compliance requirements.
• Pipeline engineering. Architect and build scalable batch and streaming pipelines in Python, PySpark, and SQL using Delta Lake and Lakeflow, including change data capture and medallion layering.
• Engineering standards. Define and enforce best practices for testing with PyTest, code review, Git based workflows, and CI/CD, and package platform assets with Databricks Asset Bundles so deployments are repeatable and auditable.
• Infrastructure as code. Own Terraform-based provisioning of Databricks workspaces and Azure resources, including ADLS Gen2, Microsoft Entra ID, and Key Vault, so every environment is reproducible from code.
• Performance and cost.



Tune distributed workloads, choose the right compute model for each workload, and put cost monitoring and controls in place.
• Technical leadership. Mentor engineers, review architecture and code, and raise the technical bar of the delivery team.
• Client partnership. Act as the senior technical point of contact for client stakeholders, translating business goals into platform roadmaps, presenting architecture recommendations, and communicating risks and trade-offs clearly. What We're Looking For
• 7+ years of professional experience in data engineering, software engineering, or data platform roles, with at least 3 years of hands-on Databricks work in production.
• Demonstrated experience as a solution architect, technical lead, or data platform owner on one or more enterprise Databricks implementations.
• Expert-level Python, PySpark, and SQL, with a consistent practice of automated testing using PyTest.
• Deep, hands-on experience with Delta Lake, Unity Catalog, Databricks Asset Bundles, and Lakeflow Jobs.
• Production experience with Terraform for provisioning Azure and Databricks infrastructure.
• Strong Azure experience, particularly ADLS Gen2, Microsoft Entra ID, and Azure networking, including secure access patterns between Azure and Databricks.
• Proven experience building and maintaining CI/CD pipelines and Git based development workflows for data platforms.
• Advanced English and the ability to communicate technical decisions clearly to engineers and executive stakeholders in a distributed, remote team.
• Based in a location that allows full overlap with US business hours. Nice to Have
• Experience designing lakehouse architectures at enterprise scale, including multi-workspace and multi-environment setups.




• A track record of optimizing distributed workloads for performance and cost, including serverless compute and liquid clustering.
• Consulting or client-facing delivery experience, ideally in finance, aerospace, e-commerce, or logistics.
• Experience implementing data governance, security, and lineage frameworks in regulated environments.
• Hands-on experience with Azure Data Factory, including pipelines, triggers, and integration runtimes, or migrating Data Factory workloads to Databricks.
• Databricks Certified Data Engineer Professional, and ideally additional certifications such as Microsoft Certified: Azure Solutions Architect Expert.
• A degree in Computer Science, Engineering, or a related field; a Master's degree is a plus. Why Lumenalta is an amazing place to work at At Lumenalta, you can expect that you will:
• Be 100% dedicated to one project at a time so that you can innovate and grow.
• Be a part of a team of talented and friendly senior-level developers.
• Work on projects that allow you to use leading tech. Salary Salary range: CA$80,000
- CA$150,000 annually, with final compensation determined by your qualifications, expertise, experience, and the role's scope.

Location:
This is a fully remote position; however, candidates must be based in regions that align with the Pacific, Central, or Eastern U.
S. time zones to ensure effective collaboration with client and team schedules. Benefits In addition to competitive pay,

we offer
a variety of benefits to support your skilled and personal growth, including:
• Flexible

working hours
in a remote workplace.
• Health insurance (medical and dental) for T4 Employees.
• A professional development fund to enhance your skills and knowledge.
• 15 days of paid time off annually.
• Access to soft-skill development courses to further your career. Position Details This is a full-time position requiring a minimum of 40 hours per week, Monday through Friday. Application Deadline Applications will be accepted until November 22nd, 2026. Candidates can expect feedback by November 30th, 2026.

📌 Senior Azure Databricks Engineer (Canada)
🏢 Lumenalta
📍 Canada

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior azure databricks engineer (canada) / canada

Subscribe to this job alert:

Get the latest job offers by email for: senior azure databricks engineer (canada) / canada