- The Government of Ontario is undertaking a large-scale Data& AI transformation initiative, with the Ontario Data Platform (ODP)serving as the enterprise technology ecosystem for data-driven decision-making,analytics, and artificial intelligence. ODP provides a modern and scalable dataenvironment supporting data ingestion, storage, processing, governance,quality, marketplace capabilities, and advanced analytics across ministries andgovernment organizations.

- We are seeking a Data Engineer / Software Developer tosupport the design, development, and operation of enterprise data solutions onthe Ontario Data Platform. The successful candidate will work with up-to-date cloudtechnologies, including Databricks, Azure Data Factory (ADF), and Azure DataLake Storage (ADLS), to build scalable data pipelines, enable analytics usecases, and support the delivery of high-quality data products acrossgovernment.

Requirements

Experience and Skill Set Requirements:

Must Haves:

- Degree or diploma in Computer Science, Software Engineering,Information Technology, or a related field.

- Experience developing data solutions using Azure DataFactory (ADF), Azure Data Lake Storage (ADLS), Databricks, Delta Lake andLakehouse architecture principles.

- Experience working with Azure DevOps, Git, CI/CD pipelines,and automated deployment practices.

- Strong proficiency in Python, SQL, and Spark-based dataprocessing frameworks.

- Knowledge of data governance, security, privacy, and accesscontrol principles.

- Experience with REST APIs, application integration patterns,and automation frameworks.

Skill Set Requirements:

Key Responsibilities:

- Design, develop, and maintain scalable batch and nearreal-time data pipelines using Azure Data Factory (ADF), Databricks, andrelated cloud technologies.

- Develop data ingestion frameworks to onboard data fromvarious source systems into the Ontario Data Platform.

- Build and optimize ETL/ELT processes to transform, cleanse,and prepare data for analytics and reporting.





- Implement data validation, monitoring, and reconciliationprocesses to ensure data quality and reliability.

- Databricks Development

- Develop and maintain notebooks, workflows, and dataprocessing jobs using Databricks.

- Build data transformation pipelines leveraging Spark andDatabricks Lakehouse architecture.

- Support the implementation of medallion architecturepatterns (Bronze, Silver, Gold).

- Monitor and troubleshoot Databricks jobs, workflows, andperformance issues.

- Develop and manage Delta Lake tables and optimize dataprocessing workloads for performance and scalability.

- Data Storage & Integration

- Design and manage data solutions utilizing Azure Data LakeStorage (ADLS).

- Collaborate with source system teams to establish secure andefficient data integration patterns.

- Implement data partitioning, optimization, and archivalstrategies to improve performance and scalability.

- Support metadata management, data cataloguing, andgovernance initiatives.

- Software Development & Automation

- Develop reusable frameworks, scripts, and utilities toautomate data engineering processes.

- Participate in DevOps practices, including CI/CD pipelines,code reviews, testing, and deployment automation.

- Maintain technical documentation, design specifications, andoperational procedures.

- Contribute to platform enhancements and continuousimprovement initiatives.

- Apply software engineering best practices including versioncontrol, test automation, code quality standards, and secure coding principles.

- Collaboration & Stakeholder Engagement

- Work closely with architects, product managers, datascientists, analysts, and business stakeholders to understand requirements anddeliver technical solutions.

- Participate in Agile teams and contribute to sprintplanning, estimation, and delivery activities.

- Provide technical guidance and knowledge sharing to teammembers and partners.

- Participate in solution architecture reviews and contributeto technology roadmaps and design decisions.

📌 11889 (Toronto)
🏢 Maarut
📍 Toronto