11 Aug
|
Vantix Systems
|
Edmonton
11 Aug
Vantix Systems
Edmonton
Intermediate Data Engineer Our Client is seeking an Intermediate Data Engineerto design and build high-impact, scalable data pipelines and platforms that drive evidence-based decision-making and regulatory excellence. Be part of a meaningful mission where your expertise ensures data is trusted, accessible, and ready for the future—helping shape policies that matter most.
Responsibilities - Design and implement secure, scalable data architecture on Microsoft Azure supporting cloud-native and hybrid needs.
- Develop data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Synapse Analytics.
- Manage data lakes and structured storage with Azure Data Lake Storage Gen2, ensuring quick and governed access.
- Integrate data from diverse sources including ServiceNow and geospatial systems using APIs and custom scripting.
- Build and optimize data models and semantic layers for analytics, reporting, and machine learning.
- Develop secure data APIs with Azure API Management for seamless data sharing.
- Enforce data governance, metadata management, and compliance standards, including privacy regulations.
- Monitor and troubleshoot data pipelines to ensure reliability and performance.
- Leverage AI tools and automation to streamline workflows and improve code quality.
Qualifications - Post-secondary degree, diploma, or certificate in Computer Science or related field.
- Proven experience building scalable data pipelines with Azure Databricks, Delta Lake, and related tools.
- Strong knowledge of Python (including PySpark), SQL, and ETL/ELT workflows in a large-scale cloud environment.
- Familiarity with Azure services like Storage, SQL, Synapse, networking, and authentication methods.
- Experience with data governance, security, and metadata management.
- Hands-on experience with version control tools like Github or Git. Nice to Have Skills - Business requirements analysis related to data manipulation and cleansing.
- Solid technical knowledge of Microsoft SQL Server.
- Experience extending solutions to Synapse Analytics and Microsoft Fabric.
- Experience with government cloud environments, Talend, RESTful APIs, and message queuing technologies.
- Familiarity with ServiceNow and enterprise data management platforms. To be considered, applicants must be legally entitled to work in Canada, including holding any required permits. We believe diverse teams build stronger companies, and we welcome applicants from all backgrounds, experiences, and perspectives.
📌 Data Engineer (Intermediate) (Edmonton)
🏢 Vantix Systems
📍 Edmonton