DataOps/Cloud Data Engineer - Senior
Onsite - Toronto ON
Mandatory Skills and Experience (8+ years experience):
- Design, build, automate and optimize complex data ETL/ELT processes using Databricks, Delta Live Tables (DLT) and equivalent.
- Development of unified data platforms using Databricks and Unity catalog or its equivalent.
- Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
- Advanced SQL skills (PL/SQL, TSQL).
- Big Data processing Frameworks (PySpark).
- Proficient in creating Azure Data Factory pipelines for copy activity and custom data pipelines in Databricks with CI CD (Azure DevOPS Git Integration) .
- Data migration and data integration across different platforms Oracle to Azure Data Lake, Oracle to Databricks,
Oracle to Microsoft Fabric.
Desirable Skills and Experience:
- Data lake design and development with focus on extracting, transforming data coming from various data sources and loading into Lakehouse in medallion architecture.
- Advanced skills and hands-on experience with Oracle databases, Azure SQL Server and Azure Data Factory.
- Cloud technologies (Azure, Google, AWS).
- PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
- Scripting languages (Python, Unix shell, Scala).
📌 DataOps/Cloud Data Engineer - Senior (Toronto)
🏢 I8IS
📍 Toronto