26 Oct
|
Celebal Technologies
|
Ottawa
26 Oct
Celebal Technologies
Ottawa
Role
- Databricks Data Engineer
Location:
Ottawa, Canada Employment Type: Contract
Experience:
8+ Years Company: Celebal Technologies Role Overview We are seeking a hands-on Lead Databricks Data Engineer to design, develop, and optimize enterprise-scale data pipelines and AI-ready data platforms using Databricks and AWS.
Key Responsibilities
• Design and develop scalable ETL/ELT pipelines using Databricks, PySpark, Python, and Advanced SQL.
• Implement Delta Lake and Medallion Architecture (Bronze/Silver/Gold).
• Manage data governance, lineage, and access controls using Unity Catalog.
• Build reusable data models, dimensional models, and AI-ready data products.
• Optimize Spark workloads, clusters, and pipeline performance.
• Implement Git, CI/CD, DataOps, data quality checks, and production monitoring.
• Own end-to-end data engineering delivery,
from requirements gathering to production deployment. Required Skills
• 8+ years of hands-on enterprise data engineering experience.
• Solid production Databricks experience, including PySpark, Delta Lake, and Unity Catalog.
• Expertise in Advanced SQL, Python, Spark, and dimensional data modeling.
• Experience with AWS or another major cloud platform.
• Strong understanding of data governance, performance tuning, and CI/CD.
• Ability to independently design and deliver scalable data engineering solutions. Preferred Skills
• Databricks Genie / AI/BI, semantic layers, and AI-ready data products.
• Manufacturing, Supply Chain, ERP/MES, or Tableau experience.
• Cloud migration, ML/MLOps, and data platform modernization.
📌 Databricks Data Engineer (Ottawa)
🏢 Celebal Technologies
📍 Ottawa