Azure Databricks Architect

Type: Long Term Contract

Role Overview:

We are seeking a Principal Azure Databricks Architect to design, architect, and deliver scalable, high-performance data solutions on Microsoft Azure. The ideal candidate will have strong hands-on expertise in Azure Databricks, ADLS, Java/Scala-based REST APIs, and Kafka/Messaging , along with the ability to provide technical leadership across data engineering initiatives.

Key Responsibilities

- Design and implement scalable Azure data architectures using Azure Databricks and ADLS.
- Develop and integrate Java/Scala-based REST APIs for data and application services.
- Design and implement real-time data pipelines using Kafka and Message Queues (MQ) .
- Lead Databricks-based data engineering and transformation solutions across enterprise environments.
- Define architecture standards, design patterns, security, performance, and scalability best practices.
- Collaborate with data engineers, application teams, architects, and business stakeholders.
- Troubleshoot complex data, integration,



and performance issues.
- Provide technical guidance and mentorship to a small team of engineers.

Must-Have Skills
- Strong experience with Azure Data Lake Storage (ADLS)
- Extensive hands-on experience with Azure Databricks
- Robust development experience with Java/Scala and REST APIs
- Hands-on experience with Kafka and/or Message Queues (MQ)
- Strong understanding of cloud-based data architecture and distributed data processing
- Experience designing scalable and highly available enterprise data solutions

Good to Have
- Experience with Python APIs and scripting
- Experience leading or mentoring small technical teams
- Knowledge of Azure data services and modern data engineering practices
- Experience with CI/CD, DevOps, and infrastructure automation

Education Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or a related field .

📌 Azure Databricks Architect (Toronto)
🏢 Confiar Services
📍 Toronto