The client is seeking a highly experienced Senior DataOps / Cloud Data Engineer to design, develop, automate, optimize, and maintain enterprise-scale data pipelines and cloud-based data platforms. The role focuses on building scalable ETL/ELT processes, developing unified data platforms, implementing enterprise data lakehouse solutions, and migrating complex data environments from traditional databases to modern cloud platforms.

Key Responsibilities

- Design, develop, automate, and optimize scalable ETL/ELT data pipelines using Databricks, Delta Live Tables (DLT), and Azure Data Factory.

- Build and maintain unified cloud data platforms using Databricks and Unity Catalog.

- Develop enterprise data warehouses, data lakes, and lakehouse solutions using medallion architecture.

- Lead data migration and integration from Oracle to Azure Data Lake, Databricks, and Microsoft Fabric.

- Develop and optimize SQL queries, relational and dimensional data models, and large-scale data processing workflows.

- Implement CI/CD pipelines, DataOps practices, and deployment automation using Azure DevOps and Git.

- Monitor, troubleshoot, and optimize data pipeline performance, reliability, and security.

Must-Have Skills

- 8+ years of experience in data engineering,



cloud data platforms, and ETL/ELT development.

- Robust hands-on experience with Databricks, Delta Live Tables (DLT), and Unity Catalog.

- Expertise in Azure Data Factory (ADF) and building custom Databricks pipelines.

- Advanced proficiency in SQL, PL/SQL, T-SQL, and PySpark.

- Strong experience with Oracle, SQL Server, MySQL, database optimization, replication, and data modelling.

- Experience with Azure DevOps, Git integration, and CI/CD automation.

- Proven experience migrating data from Oracle to Azure Data Lake, Databricks, and Microsoft Fabric.

Nice-to-Have Skills

- Experience designing data lakes and lakehouses using medallion architecture.

- Advanced knowledge of Oracle, Azure SQL Server, and Azure Data Factory.

- Exposure to AWS, Google Cloud Platform (GCP), and Azure.

- Proficiency in Python, Unix Shell scripting, and Scala.

- Experience with ETL troubleshooting, performance tuning, failover, and disaster recovery.

- Familiarity with DataOps best practices, cloud data governance, and enterprise data warehousing.

- Previous experience working on public sector or government projects.

📌 Senior DataOps / Cloud Data Engineer (Toronto)
🏢 Teckhorizon
📍 Toronto