29 Aug
|
Procom
|
Toronto
DataOps/Cloud Data Engineer - Senior:
On behalf of our Public Sector client, Procom is searching for a DataOps/Cloud Data Engineer - Senior for a 6-month role. This position is onsite 5 days a week at our client’s Toronto office.
DataOps/Cloud Data Engineer - Senior - Job Description:
This is a critical project involving the development and optimization of data pipelines using Azure Data Factory and Databricks. The successful candidate will work on designing and implementing data models using Medallion Architecture principles to support the Ministry of Public and Business Service Delivery and Procurement.
DataOps/Cloud Data Engineer - Senior - Responsibilities:
Designing, developing, and optimizing Azure Data Factory and Databricks pipelines from Oracle databases to Lakehouses
Designing and optimizing data models using Medallion Architecture principles
Designing and developing data connections from Databricks Medallion Architecture to on-premises data sources for downstream consumers
Translating Informatica ETL to Azure Data Factory and Databricks ELT
Implementing and enforcing data quality checks and governance practices
DataOps/Cloud Data Engineer - Senior - Mandatory Skills:
Experience developing ETL processes with Informatica,
Azure Data Factory, and Databricks (Python, Lakeflow, and SQL Optimization)
Experience with solution development in Databricks using Medallion Architecture
Proficiency in programming languages (Python, SQL, t-SQL, PL/SQL, Informatica, ADF, SSIS, Microsoft Fabric)
Experience with data pipeline and workflow development, orchestration, deployment, and automation
Experience with Cloud data platforms and data management
Experience in Continuous Integration/Continuous Development/Deployment (CI/CD)
Excellent verbal and written communication skills
DataOps/Cloud Data Engineer - Senior – Nice-to-Have Skills:
Databricks and/or Microsoft Fabric certifications
Experience with Azure DevOps
Experience with AODA/WCAG compliance
Experience with digital product data analysis and data security
Previous public sector experience
DataOps/Cloud Data Engineer - Senior – Assignment Length:
This is a 6-month contract position.
DataOps/Cloud Data Engineer - Senior - Start Date:
ASAP
DataOps/Cloud Data Engineer - Senior - Assignment Location:
Toronto, Ontario, Canada, onsite 5 days a week.
📌 Dataops/cloud Data Engineer Senior Toronto
🏢 Procom
📍 Toronto