13 Aug
|
StafinGo
|
Edmonton
Hiring: Senior Data Engineer
Location: Edmonton, Alberta, Remote (3-4 onsite meetings per year)
Duration: September 1, 2026 – August 31, 2027
Hourly Rate: $85/hour - $105/hour (based on experience)
Client: Public Sector
Responsibilities:
- Collaborate with business stakeholders and product owners to understand data product objectives, requirements, and success criteria
- Design and implement scalable, secure, and high-performance data architecture on Microsoft Azure, supporting both cloud-native and hybrid environments.
- Lead the development of data ingestion, transformation, and integration pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
- Work with the Data Architect and manage data lakes and structured storage solutions using Azure Data Lake Storage Gen2, ensuring productive access and governance.
- Integrate data from diverse source systems including ServiceNow, and geospatial systems, using APIs, connectors, and custom scripts.
- Develop and maintain robust data models and semantic layers to support operational reporting, analytics, and machine learning use cases and downstream consumption.
- Build and optimize data workflows using Python and SQL for data cleansing, enrichment, and advanced analytics within Azure Databricks.
- Design and expose secure data services and APIs using Azure API Management for downstream systems.
- Implement data governance practices, including metadata management, data classification, and lineage tracking.
- Ensure compliance with privacy and regulatory standards (e.g., FOIP, GDPR) through role-based access controls, encryption, and data masking.
- Monitor and troubleshoot data pipelines and integrations, ensuring reliability, scalability, and performance across the platform.
- Utilize AI and automation tools to streamline data engineering workflows, including pipeline development, testing, monitoring, and documentation.
- Leverage AI-assisted tools for code generation, optimization, and review to improve development efficiency and code quality.
- Design and curate standardized, high‑quality datasets that are suitable for advanced analytics and future AI use cases.
- Other duties as needed
Must Haves: (Certifications are highly preferred)
- Post-Secondary degree, diploma or certificate in Computer Science or related field of study.
- Minimum 3 years’ experience designing data solutions for analytics-ready, trusted datasets using tools like Power BI and Synapse, including semantic layers, data marts, and data products for self-service, data science, and reporting
- Minimum 4 years’ experience in Github/Git for version control, collaborative development, code management, and integration with data engineering workflows.
- Minimum 3 years’ experience with Azure services (Storage, SQL, Synapse, networking) for scalable, secure solutions, and with authentication (Service Principals, Managed Identities) for secure access in pipelines and integrations.
- Minimum 5 years’ experience in Python (including PySpark) and SQL, applied to developing, orchestrating, and optimizing enterprise-grade ETL/ELT workflows in a large-scale cloud environment.
- Minimum 3 years’ experience building scalable data pipelines with Azure Databricks, Delta Lake, Workflows, Jobs, and Notebooks, plus cluster management. Extending solutions to Synapse Analytics and Microsoft Fabric is a plus.
- Minimum 1 year experience using AI-Experienced in using AI for code generation, data analysis, automation, and enhancing productivity in data engineering workflows.
Nice to have:
- Minimum 6 years direct, hands-on experience performing business requirement analysis related to data manipulation/transformation, cleansing and wrangling.
- Minimum 6 years’ experience and strong technical knowledge of Microsoft SQL Server, including database design, optimization, and administration in enterprise environments.
- Minimum 2 years’ experience extending or integrating data solutions with Azure Synapse Analytics and Microsoft Fabric (Lakehouse, Warehouse, Semantic Models).
- Minimum 1-year direct experience building data products in Government of Alberta cloud environment.
- Minimum 3 years’ experience in building secure, scalable RESTful APIs for data exchange, with robust auth, error handling, and support for real-time automation.
- Minimum 3 years’ experience in Message Queueing Technologies, implementing message queuing using tools like ActiveMQ and Service Bus for scalable, asynchronous communication across distributed systems.
- Minimum 5 years’ experience working with cross-functional teams to create software applications and data products.
We appreciate all interest; however, only candidates whose experience fully meets the posted requirements will be considered.
Interested?
If you meet the above criteria apply now!
AI is not being used in the application/recruitment process for this position
📌 Senior Data Engineer (Edmonton)
🏢 StafinGo
📍 Edmonton