27 Oct
|
Celebal Technologies
|
Ottawa
27 Oct
Celebal Technologies
Ottawa
Role - Databricks Data Engineer
Location: Ottawa, Canada
Employment Type: Contract
Experience: 8+ Years
Company: Celebal Technologies
Role Overview
We are seeking a hands-on Lead Databricks Data Engineer to design, develop, and optimize enterprise-scale data pipelines and AI-ready data platforms using Databricks and AWS.
Key Responsibilities
- Design and develop scalable ETL/ELT pipelines using Databricks, PySpark, Python, and Advanced SQL.
- Implement Delta Lake and Medallion Architecture (Bronze/Silver/Gold).
- Manage data governance, lineage, and access controls using Unity Catalog.
- Build reusable data models, dimensional models, and AI-ready data products.
- Optimize Spark workloads, clusters, and pipeline performance.
- Implement Git, CI/CD, DataOps, data quality checks, and production monitoring.
- Own end-to-end data engineering delivery,
from requirements gathering to production deployment.
Required Skills
- 8+ years of hands-on enterprise data engineering experience.
- Robust production Databricks experience, including PySpark, Delta Lake, and Unity Catalog.
- Expertise in Advanced SQL, Python, Spark, and dimensional data modeling.
- Experience with AWS or another major cloud platform.
- Strong understanding of data governance, performance tuning, and CI/CD.
- Ability to independently design and deliver scalable data engineering solutions.
Preferred Skills
- Databricks Genie / AI/BI, semantic layers, and AI-ready data products.
- Manufacturing, Supply Chain, ERP/MES, or Tableau experience.
- Cloud migration, ML/MLOps, and data platform modernization.
📌 Databricks Data Engineer (Ottawa)
🏢 Celebal Technologies
📍 Ottawa