Job Title : Databricks Developer

Full-time Opportunity | On-site in Vancouver, BC | Salary: $95,000–$110,000/annum | Must hold a valid Canadian Work Visa

Our client, a leading global maritime transportation and ship management organization, is seeking a Databricks Developer to join its Data Development team in Vancouver.

Reporting to the Team Lead, Data Development, this hands-on role is responsible for designing, developing, and optimizing enterprise data pipelines using Databricks , Apache Spark , and Microsoft Azure technologies. Working closely with Data Engineers, Data Scientists, Business Analysts, and Data Architects, you will build scalable data solutions that power enterprise analytics, reporting, and operational decision-making.

This is an excellent opportunity for a data engineering professional who enjoys building modern cloud-based data platforms and working with large-scale datasets in a collaborative Agile environment.

Responsibilities:

- Design, develop, and maintain scalable data pipelines and workflows using Databricks , Apache Spark (PySpark/SQL) , and Delta Lake
- Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks notebooks to process structured and semi-structured data
- Integrate data from multiple enterprise systems and external APIs to create reliable, analytics-ready datasets
- Optimize Spark workloads and Delta Lake performance using techniques such as partitioning, Z-ordering, broadcast joins, caching, and query optimization
- Develop data ingestion pipelines for REST APIs and transform JSON data into scalable Spark tables
- Apply data modelling, data warehousing, and lakehouse architecture best practices to support enterprise analytics
- Perform data validation, quality assurance,



and reconciliation activities to ensure data accuracy and reliability
- Build and manage Azure Data Factory pipelines, linked services, datasets, and orchestration workflows supporting Databricks, Azure Data Lake Storage (ADLS), and SQL Server
- Develop parameterized and reusable ADF pipelines while integrating Databricks notebooks into automated workflows
- Develop both batch and real-time data processing solutions using streaming technologies such as Kafka, MQTT, and Azure Event Hub
- Collaborate with Data Scientists, Data Analysts, Business Analysts, and Data Architects to deliver trusted, high-quality data products
- Support data governance initiatives through metadata management, documentation, version control, and CI/CD best practices using Git and DevOps tools

Qualifications:

Required Qualifications

- Bachelor's degree in Computer Science or a related discipline, or an equivalent combination of education and experience
- Minimum 5 years of experience in data engineering, big data development, or a related role
- Strong hands-on experience with Databricks , Apache Spark , PySpark , and SQL
- Experience developing ETL/ELT solutions using Azure Data Factory and Azure Data Lake Storage
- Strong Python and SQL programming skills for data processing, transformation, and validation




- Experience integrating enterprise systems through REST APIs using libraries such as requests and http
- Strong understanding of Delta Lake architecture, performance optimization, and advanced features
- Experience designing scalable data lakehouse solutions and both batch and streaming data pipelines
- Experience with Git version control, DevOps pipelines, and Agile software development methodologies
- Excellent analytical, problem-solving, and communication skills

Preferred Qualifications

- Experience with dbt , Azure Synapse Analytics , or Microsoft Fabric
- Familiarity with Unity Catalog within Databricks
- Azure Data Engineer, Databricks, or related cloud certifications
- Experience with predictive analytics, anomaly detection, or machine learning workloads
- Experience processing IoT or telemetry data
- Experience working within enterprise cloud data platforms

Compensation & Benefits:

- Competitive salary of $95,000–$110,000 CAD , based on experience
- Annual performance bonus ( 8–12% )
- 5% RRSP matching
- 3–4 weeks of vacation
- Comprehensive benefits package
- Opportunity to work on enterprise-scale cloud data platforms supporting global operations
- Collaborative, high-performing team with opportunities for skilled growth

This is an exciting opportunity to join a global organization investing heavily in modern cloud data platforms and analytics. You'll work with cutting-edge technologies including Databricks, Azure, Apache Spark, and Delta Lake while helping build scalable data solutions that support critical business operations worldwide. NOTE : Interested candidates who meet the above qualifications are encouraged to apply directly. Due to the volume of applications, only those shortlisted will be contacted.

📌 Databricks Developer (Metro Vancouver)
🏢 Benchmark Recruitment
📍 Metro Vancouver