– DataOps/Cloud Data Engineer – Senior (Toronto)

– DataOps/Cloud Data Engineer – Senior (Toronto)

31 Aug
|
S M Software Solutions
|
Toronto

31 Aug

S M Software Solutions

Toronto

Client: Ministry of Public and Business Service Delivery and Procurement

Work Location: 777 Bay St., Toronto, Ontario – Onsite Estimated Start Date: September 1, 2026

Estimated End Date: September 1, 2027

Business Days: 250

Extension: Probable after the initial mandate

Hours: 7.25 hours per day

Security Level: No Clearance Required

Application Deadline: Friday, August 28, 2026 at 10:00 AM EST

Role Overview

We are seeking a Senior DataOps/Cloud Data Engineer to design, develop, optimize, and support enterprise-scale cloud data solutions and pipelines.

The successful candidate will have strong hands-on experience with Informatica, Azure Data Factory, Databricks, Python, SQL, T-SQL, PL/SQL, SSIS, and Microsoft Fabric , with demonstrated expertise in data pipeline development, orchestration, automation, cloud data platforms, and Databricks Medallion Architecture .

This role will focus on building and optimizing data pipelines from Oracle and other on-premises sources into cloud Lakehouse environments, developing scalable data models, supporting large-scale data migrations, implementing DataOps and data quality practices, and ensuring secure, governed, and traceable data movement across enterprise platforms.

Must-Have Skills

- Experience developing ETL processes using Informatica, Azure Data Factory, and Databricks.
- Strong experience with Python, SQL, Lakeflow, and SQL optimization.
- Experience developing solutions using Databricks Medallion Architecture.
- Strong experience with cloud data engineering and multiple programming/data technologies, including:

- Python

- SQL
- T-SQL

- PL/SQL

- Informatica

- Azure Data Factory

- SSIS

- Microsoft Fabric
- Experience developing, orchestrating, deploying, and automating data pipelines and workflows.
- Experience managing dataflow, Delta Lake indexing, parallelism, and data movement.
- Experience designing and optimizing Azure Data Factory and Databricks pipelines from Oracle databases to Lakehouse environments.
- Experience translating Informatica ETL to Azure Data Factory and Databricks ELT.

Key Responsibilities
- Cloud Data Engineering & Pipeline Development
- Design, develop, and optimize Azure Data Factory and Databricks pipelines.
- Build data pipelines from Oracle and other on-premises databases into cloud Lakehouse environments.
- Develop and manage data processing workflows, orchestration, deployment, and automation.
- Develop scalable pipelines to manage dataflow, Delta Lake indexing, parallelism, and data movement.
- Build automated data jobs, scripts, and integration processes across multiple platforms.
- Develop and optimize data connections between Databricks Medallion Architecture and on-premises data sources.
- Support downstream data consumers with reliable and optimized data services.
- Databricks & Medallion Architecture
- Design and develop enterprise data solutions using Databricks Medallion Architecture.
- Develop and optimize Bronze, Silver, and Gold data layers.
- Design and optimize data models supporting Lakehouse environments.
- Manage Delta Lake storage, indexing, processing, and performance.
- Support data Lakehouse architecture and implementation.
- Develop solutions using Databricks and/or Microsoft Fabric.
- Apply cloud data engineering best practices to scalable enterprise environments.
- ETL/ELT Modernization & Data Migration
- Translate existing Informatica ETL processes into Azure Data Factory and Databricks ELT solutions.
- Design and implement data conversion and migration strategies for very large datasets.
- Support migration of OLAP and OLTP environments to cloud SaaS, PaaS, and IaaS environments.
- Develop data mapping and transformation processes.
- Support enterprise data warehouse, data lake, and data Lakehouse implementations.
- Design fact and dimension models and enterprise data structures.
- Develop star-schema and multi-dimensional data models.
- Document detailed logical and physical data models.
- Data Architecture, Modelling & Integration
- Design and optimize relational data models.
- Develop conceptual, logical, and physical data models.
- Design data warehouses, data lakes, and Lakehouse solutions.
- Support structured, semi-structured,



and unstructured data ingestion and provisioning.
- Develop data exchange and integration solutions.
- Integrate APIs and data exchange technologies.
- Support digital product data requirements and data provisioning.
- Apply information architecture and enterprise data standards.
- DataOps, Quality & Performance
- Implement DataOps best practices across cloud data engineering processes.
- Monitor and tune DataOps and pipeline performance.
- Implement data quality checks and validation processes.
- Perform data profiling, cleansing, validation, and monitoring.
- Identify and resolve data quality issues.
- Develop and maintain data lineage reports to provide end-to-end visibility into data movement and transformations.
- Implement continuous integration, continuous development, and continuous deployment (CI/CD) practices.
- Automate data provisioning and deployment processes.
- Data Security, Governance & Compliance
- Apply data governance practices across enterprise data environments.
- Integrate and manage Microsoft Entra ID for authentication, authorization, and role-based access control.
- Implement data anonymization and masking techniques.
- Protect sensitive and regulated data in accordance with privacy requirements.
- Apply security principles across cloud data platforms and data pipelines.
- Ensure solutions comply with applicable AODA/WCAG requirements.

- Cloud Data Services
- Manage cloud data services supporting project delivery, including:

- Azure Storage Accounts

- Data Lakehouse

- Key Vault

- Virtual Machines

- Parquet files

- Data repositories

- Cloud storage platforms
- Support cloud and on-premises data integration.
- Work with data storage, database, and data exchange technologies.
- Support Data as a Service (DaaS), Database as a Service (DBaaS), and other cloud storage platforms.
- Production Support & Troubleshooting
- Troubleshoot production data pipeline and application issues.
- Investigate defects and implement corrective fixes.
- Support unplanned deployments and production fixes.
- Perform defect investigation, resolution, and assignment.
- Monitor system performance and resolve data processing issues.
- Participate in system, integration, and user acceptance testing.
- Support SIT, SAT, UAT, and unit testing activities.

Experience & Skill Set Requirements Technical Experience – 40%

- Strong experience developing ETL processes using Informatica, Azure Data Factory, and Databricks.
- Robust experience with Python, SQL, T-SQL, PL/SQL, Informatica, ADF, SSIS, and/or Microsoft Fabric.
- Experience developing solutions using Databricks Medallion Architecture.
- Experience with cloud data platforms, data management, and data exchange technologies.
- Experience managing Delta Lake and cloud data storage environments.
- Experience developing and managing enterprise data pipelines and workflows.
- Experience with data orchestration, deployment, automation, and pipeline optimization.
- Experience with CI/CD and data provisioning automation.
- Experience with data integration APIs and data exchange.
- Experience with very large-scale OLAP and OLTP data migration to cloud environments.
- Experience designing fact/dimension models, data warehouses, data lakes, and Lakehouse solutions.
- Experience developing star-schema and multi-dimensional models.
- Experience managing Azure cloud data services.
- Experience with structured, semi-structured, and unstructured data.
- Experience with DataOps performance monitoring and tuning.
- Experience implementing data quality, profiling, cleansing, validation, and monitoring.
- Experience applying data governance and information architecture standards.
- Experience integrating Microsoft Entra ID and implementing role-based access control.
- Experience implementing data anonymization and masking.
- Experience developing data lineage reports.




- Databricks and/or Microsoft Fabric certification is an asset.

Core Skills – 35%
- Excellent analytical, problem-solving, decision-making, communication, presentation, interpersonal, and negotiation skills.
- Strong solution development and design experience across technology, data, databases, applications, statistics, and networking.
- Experience leading or supporting Business Intelligence and enterprise data projects.
- Strong understanding of DataOps best practices and Agile development/deployment.
- Experience analyzing large and diverse datasets.
- Experience with data visualization, KPI development, and data profiling.
- Experience manipulating and analyzing complex, high-volume structured and unstructured data.
- Experience preparing business, system, and technical requirements documentation.
- Experience with advanced data visualization tools and techniques.
- Experience troubleshooting production issues and implementing corrective fixes.
- Experience with defect investigation and resolution.
- Experience coordinating modernization of large, complex, multi-platform, multi-tier IT systems.
- Experience with Azure DevOps.
- Experience with AODA/WCAG compliance.
- Strong track record of meeting deadlines and delivering high-quality solutions.

Project Experience & Techniques – 15%
- Experience with SDLC processes and Agile and Waterfall methodologies.

- Experience conducting

- Unit Testing

- System Testing

- SIT

- SAT

- UAT
- Experience communicating daily project tasks, issues, risks, and progress.
- Experience tracking and facilitating resolution of technical issues and risks.
- Experience gathering and consolidating business and system requirements.
- Experience managing change requests and project artifacts.
- Experience leading requirements-gathering sessions.

General Skills – 5%
- Strong problem-solving and decision-making abilities.
- Excellent written and verbal communication skills.
- Experience working with and leading multiple teams.
- Ability to coordinate multiple projects with competing priorities.
- Proven ability to meet strict deadlines.
- Strong collaboration and team-integration skills.
- Experience providing technical advice and guidance.
- Ability to work effectively with business users and IT development teams.
- Ability to ensure business requirements are accurately reflected in system designs and technical specifications.

Organization Experience – 5%
- Previous public sector experience within an organization of comparable size and complexity.
- Experience working within large, complex, enterprise technology environments.

Key Deliverables & Outcomes
- Design and deliver scalable Azure and Databricks data pipelines.
- Modernize legacy Informatica ETL processes into ADF and Databricks ELT solutions.
- Build and optimize enterprise Lakehouse solutions using Medallion Architecture.
- Deliver reliable and efficient data movement between on-premises and cloud environments.
- Develop enterprise data models, data warehouses, data lakes, and Lakehouse solutions.
- Implement strong DataOps, CI/CD, data quality, security, governance, and lineage practices.
- Support large-scale cloud data migration and modernization initiatives.
- Ensure secure, governed, traceable, and high-quality enterprise data.
- Provide production support, troubleshooting, technical documentation, and knowledge transfer.
- Collaborate effectively with business and technical stakeholders to deliver project outcomes.

How to Apply If you are interested and your profile matches the requirements, please send the following documents to [email protected] by Friday, August 28, 2026 at 10:00 AM EST :

- Updated Resume in Word format – Mandatory
- References – Mandatory
- Expected Hourly Rate – Mandatory
- Visa Status – Mandatory
- LinkedIn ID – Mandatory

Important: Applications without all mandatory documents cannot be processed. If this opportunity is not suitable for you, please feel free to forward it to qualified Senior DataOps/Cloud Data Engineers with strong Informatica, Azure Data Factory, Databricks, Python, SQL, Medallion Architecture, ETL/ELT, DataOps, cloud migration, data modelling, and enterprise data engineering experience.

📌 – DataOps/Cloud Data Engineer – Senior (Toronto)
🏢 S M Software Solutions
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: – dataops/cloud data engineer – senior (toronto) / toronto

Subscribe to this job alert:

Get the latest job offers by email for: – dataops/cloud data engineer – senior (toronto) / toronto