- The Government of Ontario is undertaking a large-scale Data& AI transformation initiative, with the Ontario Data Platform (ODP)serving as the enterprise technology ecosystem for data-driven decision-making,analytics, and artificial intelligence. ODP provides a contemporary and scalable dataenvironment supporting data ingestion, storage, processing, governance,quality, marketplace capabilities, and advanced analytics across ministries andgovernment organizations.

- We are seeking a Data Engineer / Software Developer tosupport the design, development, and operation of enterprise data solutions onthe Ontario Data Platform. The successful candidate will work with modern cloudtechnologies, including Databricks, Azure Data Factory (ADF), and Azure DataLake Storage (ADLS), to build scalable data pipelines, enable analytics usecases, and support the delivery of high-quality data products acrossgovernment.

Requirements

Experience and Skill Set Requirements:

Must Haves:

- Degree or diploma in Computer Science, Software Engineering,Information Technology, or a related field.

- Experience developing data solutions using Azure DataFactory (ADF), Azure Data Lake Storage (ADLS), Databricks, Delta Lake andLakehouse architecture principles.

- Experience working with Azure DevOps, Git, CI/CD pipelines,and automated deployment practices.

- Strong proficiency in Python, SQL, and Spark-based dataprocessing frameworks.

- Knowledge of data governance, security, privacy, and accesscontrol principles.

- Experience with REST APIs, application integration patterns,and automation frameworks.

Skill Set Requirements:

Key Responsibilities:

- Design, develop, and maintain scalable batch and nearreal-time data pipelines using Azure Data Factory (ADF), Databricks, andrelated cloud technologies.

- Develop data ingestion frameworks to onboard data fromvarious source systems into the Ontario Data Platform.

- Build and optimize ETL/ELT processes to transform, cleanse,and prepare data for analytics and reporting.





- Implement data validation, monitoring, and reconciliationprocesses to ensure data quality and reliability.

- Databricks Development

- Develop and maintain notebooks, workflows, and dataprocessing jobs using Databricks.

- Build data transformation pipelines leveraging Spark andDatabricks Lakehouse architecture.

- Support the implementation of medallion architecturepatterns (Bronze, Silver, Gold).

- Monitor and troubleshoot Databricks jobs, workflows, andperformance issues.

- Develop and manage Delta Lake tables and optimize dataprocessing workloads for performance and scalability.

- Data Storage & Integration

- Design and manage data solutions utilizing Azure Data LakeStorage (ADLS).

- Collaborate with source system teams to establish secure andefficient data integration patterns.

- Implement data partitioning, optimization, and archivalstrategies to improve performance and scalability.

- Support metadata management, data cataloguing, andgovernance initiatives.

- Software Development & Automation

- Develop reusable frameworks, scripts, and utilities toautomate data engineering processes.

- Participate in DevOps practices, including CI/CD pipelines,code reviews, testing, and deployment automation.

- Maintain technical documentation, design specifications, andoperational procedures.

- Contribute to platform enhancements and continuousimprovement initiatives.

- Apply software engineering best practices including versioncontrol, test automation, code quality standards, and secure coding principles.

- Collaboration & Stakeholder Engagement

- Work closely with architects, product managers, datascientists, analysts, and business stakeholders to understand requirements anddeliver technical solutions.

- Participate in Agile teams and contribute to sprintplanning, estimation, and delivery activities.

- Provide technical guidance and knowledge sharing to teammembers and partners.

- Participate in solution architecture reviews and contributeto technology roadmaps and design decisions.

📌 11889 (Toronto)
🏢 Maarut
📍 Toronto