Databricks Data Platform Engineer (Winnipeg)

Databricks Data Platform Engineer (Winnipeg)

16 Nov
|
Mindtris
|
Winnipeg

16 Nov

Mindtris

Winnipeg

Job Title: Senior Databricks Data Platform Engineer Location: Canada, Remote Senior Level Estimated Duration: 1 year contract with possible extension Job SummaryWe are looking for a highly experienced Senior Databricks Data Platform Engineer to own the engineering, automation, administration, and optimization of an enterprise Databricks Lakehouse platform. The ideal candidate should have strong hands‑on experience in Databricks platform administration, Unity Catalog, Terraform, CI/CD automation, platform cost optimization (FinOps), Delta Lake, and cloud infrastructure. This is a platform engineering role rather than a traditional data pipeline development position.

The candidate will be responsible for building a secure, scalable, reliable, and cost‑efficient Databricks platform while enabling engineering and data science teams.

Databricks Platform

Engineering & Administration Own Databricks environments across development, testing, and production.

Administer Unity

Catalog, including metastores, catalogs, schemas, external locations, and access controls. Manage compute resources, cluster policies, SQL warehouses, and serverless compute.

Manage Databricks

Runtime upgrades and platform configurations. Build CI/CD pipelines using Databricks Asset Bundles, Git folders, Azure DevOps, or GitHub Actions.

Implement

Terraform for Databricks and cloud infrastructure. Automate testing, security scanning, and deployment workflows. Automate SCIM provisioning, secret management, token rotation, and environment drift detection.

Agentic

Workflows & AI-Enabled Operations Develop AI-driven workflows for job failure analysis,



root-cause investigation, and cost anomaly detection. Build AI agents using Mosaic AI Agent Framework, Model Serving, and Vector Search. Implement AI governance, observability, evaluation, and human-in-the-loop controls.

Support

GenAI, RAG, and ML workloads.

Monitor

Databricks usage and costs using system tables. Optimize cluster sizing, autoscaling, auto-termination, Photon, and serverless compute. Support DBU forecasting and capacity planning. Storage & Performance Optimization Optimize ADLS Gen2 / S3 storage and retention policies.

Tune Spark and SQL workloads. Identify and resolve small-file issues, redundant data, and storage inefficiencies. Implement secure platform controls and least-privilege access. Implement data masking, classification, and row/column-level security.

Mentor engineers and promote Databricks best practices. 7+ years of experience in data engineering, data platform, or DevOps roles. 3+ years of enterprise Databricks administration and engineering experience. Robust expertise in Unity Catalog, workspace administration, cluster policies, and Databricks Workflows. Hands‑on experience with Databricks Asset Bundles and Terraform.





Experience building CI/CD pipelines using Azure DevOps, GitHub Actions, or similar tools. Demonstrated experience in Databricks cost optimization and FinOps. Strong programming skills in Python and SQL, with working knowledge of PySpark.

Experience with Azure, AWS, or GCP.

Experience implementing security and governance for sensitive data.

Experience with Agentic AI and GenAI frameworks such as Mosaic AI, LangChain, and LangGraph.

Databricks Data Engineer

Professional or Platform Administrator certifications.

Experience with Databricks system tables and FinOps dashboards. Knowledge of Lakeflow, Delta Live Tables, Databricks SQL, and MLOps.

Experience migrating workloads from Hadoop, Snowflake, or legacy platforms to Databricks.

Personal Attributes

Cost‑conscious and data‑driven approach. Ability to mentor engineers and drive platform engineering best practices. Mindtris, a minority women‑owned enterprise, is at the forefront of digital transformation, technology excellence, and business growth solutions.

Specializing in talent mobilization and innovation, we are dedicated to enhancing customer experiences across diverse sectors such as Information Technology, Telecommunications, Healthcare, Engineering, and the Public sector. With a focus on deploying top‑tier talent and fostering innovation, we empower businesses to thrive and excel in a rapidly evolving digital landscape, helping them reach new heights of success. Mindtris is committed to fostering workforce diversity and is proud to be an equal opportunity employer. #

📌 Databricks Data Platform Engineer (Winnipeg)
🏢 Mindtris
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: databricks data platform engineer (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: databricks data platform engineer (winnipeg) / winnipeg