Azure Databricks Architect (Manitoba)

Azure Databricks Architect (Manitoba)

21 Nov
|
Newnovation
|
Manitoba

21 Nov

Newnovation

Manitoba

Employment Type: Full time

Role Overview
We are seeking a hands-on Azure Databricks Architect to lead the design, governance, and scaling of our enterprise Lakehouse and conversational AI analytics platform. A mandatory focus of this role is architecting, deploying, and tuning Azure Databricks Genie (Genie Agents / Genie Spaces) to enable business users to query structured and unstructured enterprise data using natural language.

Key Responsibilities

Databricks Genie Architecture & Optimization: Design, configure, and manage production Genie Agents (formerly Genie Spaces) on top of Unity Catalog. Curate table/column metadata, semantic instructions, knowledge stores, and trusted assets (parameterized example SQL queries and functions) to ensure high-accuracy natural-language-to-SQL generation.

Lakehouse & Data Platform Engineering: Architect end-to-end batch and real-time data pipelines using Azure Databricks, Apache Spark (PySpark/SQL), Delta Lake, and Delta Live Tables across Medallion (Bronze/Silver/Gold) architectures.

Governance & Security:



Implement enterprise data governance via Unity Catalog , enforcing row-level security, column masking, ACLs, and audit controls so Genie Agents dynamically respect end-user permissions.

Compute & Cost Optimization: Manage Pro and Serverless SQL Warehouses, cluster policies, and query performance tuning (OPTIMIZE, Z-ORDER, Liquid Clustering) while monitoring and controlling Databricks and Genie consumption budgets.

Azure Ecosystem & CI/CD Integration: Integrate Databricks with core Azure services (Azure Data Factory, ADLS Gen2, Event Hubs, Azure Key Vault, Microsoft Entra ID) and standardize automated deployments using Databricks Asset Bundles (DABs), Terraform, or Azure DevOps/GitHub Actions.

Stakeholder Enablement: Partner with business analysts, domain leads, and data engineers to translate business KPIs into well-annotated semantic models and Agent-mode workflows.

#J-18808-Ljbffr

📌 Azure Databricks Architect (Manitoba)
🏢 Newnovation
📍 Manitoba

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks architect (manitoba) / manitoba

Subscribe to this job alert:

Get the latest job offers by email for: azure databricks architect (manitoba) / manitoba