21 Nov
|
2iSolutions
|
Oshawa
21 Nov
2iSolutions
Oshawa
Our Client in Oshawa is looking to hire a Senior Data Engineer/Developer with deep experience with Microsoft Technologies. This is a 3 year contract role
- hybrid 3 days/week on-site in Oshawa. We are looking for candidates who can participate in architecture/design forums, define the right solution and standards, and then personally build, troubleshoot, and optimize that solution.
• 8+ years of hands-on data engineering/development experience, ideally with recent hands-on coding.
• Robust SQL and Python, with practical experience building complex production-grade data pipelines.
• Strong Spark/PySpark experience processing large-scale datasets and optimizing distributed workloads.
• Deep experience designing ETL/ELT architectures, including ingestion, transformation, orchestration, error handling, monitoring, and data quality.
• Strong data architecture experience, including dimensional modeling, data lake/lakehouse design, integration patterns,
and designing solutions across multiple source systems.
• Significant hands-on experience with Azure data technologies, ideally Azure Data Factory, Azure Databricks, ADLS, Synapse/Fabric, or equivalent.
• Experience making architecture decisions and trade-offs, not simply implementing designs provided by an architect.
• Practical understanding of data strategy, including governance, data ownership, metadata/cataloguing, data quality, security, scalability, and platform standards.
• Experience defining reusable patterns/frameworks for ingestion, transformation, CI/CD, monitoring, and data quality rather than building one-off pipelines.
• Ability to troubleshoot and optimize production workloads, including SQL performance, Spark jobs, pipeline failures, and large-volume processing. Please reach out to discuss the position further.....
📌 Data Engineer/Developer (Oshawa)
🏢 2iSolutions
📍 Oshawa