29 Aug
|
MSZ Systems
|
Toronto
29 Aug
MSZ Systems
Toronto
Senior DataOps / Cloud Data Engineer – Azure Databricks
Location: Toronto, ON
Work Model: 100% Onsite – 5 days/week
Contract: Long-term
We are seeking a Senior DataOps / Cloud Data Engineer with solid hands-on experience in Azure Databricks, Azure Data Factory, Informatica, Python/PySpark, SQL and Delta Lake .
Key Responsibilities
- Design, develop and optimize ADF and Databricks ETL/ELT pipelines .
- Build pipelines integrating Oracle/on-premises data sources with Azure Lakehouse platforms.
- Migrate/translate Informatica ETL workflows to ADF and Databricks .
- Design Databricks Medallion Architecture – Bronze, Silver and Gold layers .
- Develop and optimize Delta Lake solutions, including partitioning, indexing and performance tuning.
- Build dimensional models including Star Schema,
Fact/Dimension and data warehouse models .
- Develop automation and orchestration using Python, PySpark, SQL, T-SQL and PL/SQL .
- Implement CI/CD using Azure DevOps/Git .
- Apply data quality, governance, lineage, security, RBAC and data masking standards.
- Troubleshoot production pipelines and optimize high-volume data processing workloads.
Must-Have Skills
- Azure Databricks
- Azure Data Factory
- Informatica
- Python / PySpark
- SQL / T-SQL / PL/SQL
- Delta Lake / Lakehouse
- Medallion Architecture
- ETL/ELT pipeline orchestration
- Azure DevOps / CI/CD
- Data modelling / dimensional modelling
📌 Data Engineer (Toronto)
🏢 MSZ Systems
📍 Toronto