01 Aug
|
Russell Tobin
|
Edmonton
01 Aug
Russell Tobin
Edmonton
Russell Tobin & Associates is hiring on behalf of one of its esteemed clients.
Job ID:
Job Title: Data Engineer - Intermediate
Location: Edmonton, Alberta (Primarily Remote; On-site meetings as required)
Travel: Occasional in office meetings in Edmonton (3-4 times per month as required)
Duration: 163 Business Days with possible extension
Client: Public Sector
Pay Rate: CAD $60 -$80 per hour
Job Summary
We are seeking a Senior Data Engineer to support a large-scale digital transformation initiative focused on modernizing enterprise data platforms and analytics capabilities. The successful candidate will design, develop, and maintain scalable cloud-based data solutions on Microsoft Azure, enabling trusted, analytics-ready data products that support regulatory, operational, and business intelligence initiatives. This role requires strong expertise in Azure data services, data engineering, governance, automation, and collaboration with cross-functional teams.
Key Responsibilities
- Design and implement scalable, secure, and high-performance data architectures using Microsoft Azure.
- Develop and maintain data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Build and manage Azure Data Lake Storage Gen2 solutions and structured data repositories.
- Integrate data from multiple enterprise systems using APIs, connectors, and custom scripts.
- Develop robust data models and semantic layers to support reporting, analytics, and AI/ML initiatives.
- Build optimized data workflows using Python and SQL for cleansing, transformation, and enrichment.
- Design and expose secure APIs through Azure API Management.
- Implement data governance practices, including metadata management, lineage tracking,
and data classification.
- Ensure compliance with data privacy and security standards through encryption, masking, and role-based access controls.
- Monitor, troubleshoot, and optimize data pipelines to ensure reliability and performance.
- Utilize AI-assisted tools for code generation, testing, documentation, monitoring, and workflow automation.
- Create standardized, analytics-ready datasets to support advanced analytics and future AI initiatives.
- Collaborate with architects, business stakeholders, and technical teams to deliver high-quality data solutions.
Mandatory Qualifications
- Post-secondary degree, diploma, or certificate in Computer Science or a related discipline.
- 5+ years of hands-on experience with Python and SQL for data engineering.
- 4+ years of experience using Git/GitHub for version control and collaborative development.
- 3+ years of experience building scalable Azure Databricks and Delta Lake data pipelines.
- 3+ years of experience designing analytics-ready data platforms.
- 3+ years of experience with Azure infrastructure, cloud services, and authentication.
- 2+ years of experience implementing data governance, metadata management, and security within Databricks.
- 1+ year of experience using AI-driven tools for code generation, automation, or analysis.
Preferred Qualifications
- Experience performing business requirements analysis for data solutions.
- Strong knowledge of Microsoft SQL Server.
- Experience with Microsoft Fabric.
- Experience designing scalable ETL pipelines.
- Experience designing and integrating RESTful APIs.
- Experience working with ServiceNow integrations.
- Experience with messaging and queueing technologies.
- Experience collaborating with cross-functional software development teams.
#J-18808-Ljbffr
📌 Data Engineer - Intermediate (26-22209) (Edmonton)
🏢 Russell Tobin
📍 Edmonton