10 Nov
|
Highspring
|
Montreal
10 Nov
Highspring
Montreal
About Highspring
Highspring partners with organizations undergoing large-scale digital transformation initiatives, helping them modernize technology platforms and maximize the value of their data through innovative, business-driven solutions.
The Opportunity
We are seeking an experienced Data Engineer to design, build, and support scalable data solutions leveraging Microsoft Azure and Microsoft Fabric . In this role, you will work closely with architects, analysts, data scientists, and business stakeholders to deliver reliable data ingestion, integration, storage, transformation, and analytics capabilities in a high-volume environment.
What You'll Do
- Design, develop, test, deploy, and maintain scalable batch and real-time data pipelines.
- Build data ingestion and transformation workflows using Azure Data Factory, Microsoft Fabric Data Factory, Azure Databricks, Python, PySpark, and SQL.
- Implement Lakehouse, Data Lake, and Data Warehouse solutions using OneLake, Azure Data Lake Storage, Fabric Lakehouse, Fabric Warehouse, and Azure Synapse Analytics.
- Develop reusable data models, APIs, transformation frameworks, and integration components.
- Optimize pipelines, Spark workloads, queries, storage formats, and compute resources for performance, reliability, and cost efficiency.
- Implement data quality controls, monitoring, alerting, logging, lineage, and error-handling processes.
- Support streaming and event-driven solutions using Event Hubs, Service Bus, Fabric Real-Time Intelligence, and related technologies.
- Apply security, governance, privacy, access control, and data retention standards across the platform.
- Build and maintain CI/CD pipelines using Azure DevOps and Git.
- Collaborate with cross-functional teams to deliver production-ready data solutions.
- Troubleshoot production issues, perform root-cause analysis,
and drive continuous improvements.
- Maintain technical documentation, data mappings, operational procedures, and solution diagrams.
What You'll Bring
- Bachelor's degree in Computer Science, Software Engineering, Information Technology, Data Engineering, or a related field.
- 5+ years of experience in Data Engineering, Data Integration, or Cloud Data Platform development.
- Robust hands-on experience building large-scale data platforms on Microsoft Azure.
- Practical experience with Microsoft Fabric, including OneLake, Lakehouse, Data Factory, Spark, Notebooks, Data Warehouse, Real-Time Intelligence, Semantic Models, and Power BI integration.
- Advanced proficiency in Python or PySpark and strong SQL skills.
- Experience with Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL.
- Strong understanding of ETL/ELT processes, dimensional modeling, data warehousing, Lakehouse architecture, Delta Lake, APIs, and batch/streaming data processing.
- Experience with Git, Azure DevOps, automated testing, CI/CD, and release management practices.
- Knowledge of data security, governance, lineage, observability, and monitoring concepts.
- Excellent analytical, problem-solving, collaboration, and communication skills.
Additional Assets
- Experience delivering cloud data platform modernization, migration, or transformation initiatives.
- Knowledge of Medallion Architecture, Data Mesh, metadata-driven pipelines, and reusable engineering frameworks.
- Experience with Infrastructure as Code using Terraform, Bicep, or ARM Templates.
- Familiarity with containerization, orchestration, DevOps, and DataOps practices.
- Experience working within regulated, enterprise-scale, or mission-critical environments.
- Relevant certifications such as:
- Microsoft Certified: Fabric Data Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
📌 Senior Data engineer (Montreal)
🏢 Highspring
📍 Montreal