24 Sep
|
Ardent Softsol
|
Toronto
24 Sep
Ardent Softsol
Toronto
Role Summary The Databricks Architect is responsible for designing, implementing, and governing enterprise data platforms on Azure Databricks. The role leads platform architecture, workspace provisioning, data lake design, security controls, metadata management, and source system integration to enable scalable, secure, and governed analytics and data engineering capabilities.
Key Responsibilities
- Design Databricks workspace, compute, networking, and private-access architecture.
- Define data lake architecture, including Bronze, checkpoint, archive, and quarantine zones.
- Establish data orchestration patterns, catalog structures, and platform standards.
- Develop high-level and low-level solution designs (HLD/LLD).
- Lead deployment and configuration of Databricks environments using approved automation frameworks.
- Implement security, governance, and access controls using Unity Catalog and Azure Key Vault.
- Configure and secure ADLS Gen2 storage, private endpoints, retention policies, and access management.
- Design and validate source system connectivity, authentication mechanisms, and data ingestion frameworks.
- Define cluster, runtime, operational, and security standards for the platform.
- Support testing, validation, troubleshooting, and production readiness activities.
Required Skills & Experience
- Solid experience with Azure Databricks architecture and administration.
- Expertise in ADLS Gen2, Unity Catalog, Azure Key Vault, Private Link, and networking.
- Experience designing enterprise-scale data lakehouse and data platform solutions.
- Knowledge of data governance, security, IAM, secrets management, and compliance controls.
- Experience with CI/CD, Infrastructure as Code (Terraform preferred), and platform automation.
- Strong understanding of data integration, ingestion patterns, and enterprise source connectivity.
📌 Databricks Architect (Toronto)
🏢 Ardent Softsol
📍 Toronto