Azure Databricks expertise drives this Senior Data Engineer opportunity with Sobeys in Stellarton or Mississauga. Build streaming solutions and optimize data platforms.
As part of Sobeys’ Data Integration Hub, you will enhance and maintain integration capabilities supporting major program deliverables. Translate data requirements into designs and implementations while working with business SMEs, architects, and technical leads. The position emphasizes Azure Databricks, Spark, and event-driven solutions.
Key Responsibilities:
- Enhance and maintain the Data Integration Hub
- Translate data requirements into designs and implementations
- Develop streaming and event-driven Azure Databricks solutions
- Optimize solution performance and costs
- Mentor junior engineers and advise leadership
Requirements:
- Five-plus years developing with Spark and Azure Databricks
- Solid DLT framework and structured streaming knowledge
- Experience building scalable data ingestion frameworks
- Experience enabling and using Unity Catalog
- Azure DevOps, CI/CD, and test-driven development experience
Bring Spark, Azure Databricks, streaming, and optimization expertise to Sobeys’ Data Integration Hub in Stellarton or Mississauga.