06 Nov
|
Exchange Solutions
|
Toronto
06 Nov
Exchange Solutions
Toronto
The Senior Data Engineer reports to the Director, Information Technology Operations and designs, builds, and scales the data systems that support analytics, AI-enabled experiences, and organizational decision-making. The role owns significant parts of the data platform, including production pipelines, transformation layers, data models, semantic layers, data quality, observability, and engineering standards. It provides technical direction, mentors engineers and analysts, and partners with technical and business teams to deliver trusted, well-modelled data products. The role also evaluates and implements AI-assisted data engineering capabilities to improve pipeline development, transformation, documentation, metadata, data quality, and governed access to enterprise data while maintaining appropriate engineering controls and review.
Primary Responsibilities:
Data Platform Architecture & Technical Direction
- Responsible for key contribution of significant parts of the data platform and drive long-term architectural decisions related to tooling, data modelling, semantic architecture, automation, and scalability.
- Design data platform capabilities that reliably support analytics, reporting, operational use cases, and AI-enabled experiences.
- Evaluate technical options and establish reusable patterns that improve platform maintainability, extensibility, and engineering effectiveness.
- Design, build, and maintain scalable, reliable production data pipelines and transformation layers using dbt and a medallion Bronze, Silver, and Gold architecture.
- Write advanced SQL and Python to develop transformations, frameworks, automation, and reusable engineering tooling.
- Responsible for production data pipelines end-to-end,
including design, development, testing, deployment, monitoring, troubleshooting, optimization, and ongoing support.
Data Modelling & Semantic Architecture
- Lead data modelling across dimensional models, slowly changing dimensions, fact and dimension design, and well-structured Silver and Gold layers.
- Design and evolve semantic layers that define business entities, metrics, relationships, calculations, and governed business logic for consistent use across BI, analytics, and AI applications.
- Develop metadata-driven and governed data structures that make enterprise data discoverable, understandable, and consistently consumable.
- Evaluate and apply AI-assisted engineering approaches to accelerate pipeline design, transformation logic, SQL generation, testing, documentation, troubleshooting, and optimization while maintaining robust review and engineering controls.
- Explore AI-assisted schema understanding, metadata generation, relationship discovery, business-concept mapping, and generation of semantic definitions.
- Partner with Analytics and Innovation AI Labs to enable natural-language-to-data, intelligent analytics, semantic retrieval, and other AI or LLM-based uses of governed enterprise data.
Data Quality & Observability
- Responsible for evolving key elements of the data quality strategy, including testing frameworks,
monitoring, alerting, service levels, observability, anomaly detection, and platform-wide validation.
- Implement controls that identify pipeline, transformation, model, metadata, and semantic-layer issues early and support timely root-cause analysis and remediation.
- Promote trusted data products through clear quality standards, transparent monitoring, and continuous improvement of reliability and usability.
Engineering Practices & Delivery Standards
- Establish and champion engineering practices covering version control, CI/CD, code review, documentation, automated testing, clean maintainable code, and dbt project standards.
- Develop reusable frameworks and automation that improve delivery consistency, reduce manual effort, and support safe changes across data environments.
- Contribute to governance, cataloguing, lineage, metadata management, and data-contract practices that strengthen understanding and control of enterprise data.
- Collaborate with analysts, data scientists, product teams, and business stakeholders to translate business requirements into trusted, well-modelled data products.
- Mentor and support engineers and analysts, provide technical guidance, and contribute to team capability and engineering maturity.
- Communicate architecture decisions, data definitions, quality expectations, risks, and technical trade-offs clearly to technical and business stakeholders.
- Contribute to the culture of the company, fostering Exchange Solutions' core values and policies.
Capability Requirements - Education, Skills & Experience:
Education & Experience
- Post secondary education, with a degree i
📌 Senior Data Engineer (Toronto)
🏢 Exchange Solutions
📍 Toronto