Insight Global is hiring a Senior Data Engineer for a large retail client in Vancouver, BC. This role sits within the Data & Analytics organization and will support the Guest Data Lake platform, which enables trusted, scalable access to customer and guest data across digital, analytics, reporting, and personalization initiatives.The ideal candidate brings deep experience building cloud-native data platforms, designing scalable data solutions, and supporting customer data domains using Azure, Databricks, PySpark, and SQL. You will work closely with Data Engineering, Analytics, Data Science, and business teams to deliver reliable, governed, and high-performing data products.What You'll DoDesign and implement scalable data architectures, including batch, streaming, and lakehouse solutionsEnhance and support the Guest Data Lake platform to ensure reliable, high-quality customer data accessBuild and optimize ETL/ELT pipelines for structured and semi-structured data sourcesEnable analytics, personalization, reporting, and digital experience initiatives through customer data solutionsLead migrations from legacy platforms to up-to-date cloud-native architecturesImprove data quality, observability, monitoring, and governance frameworksPartner with Data Science and Analytics teams to deliver ML-ready and analytics-ready datasetsTranslate business requirements into scalable technical solutionsDrive CI/CD, Infrastructure-as-Code, and software engineering best practicesParticipate in architecture reviews, technical design discussions, and platform roadmap planningMentor junior engineers through code reviews and technical guidanceOptimize platform performance, security, scalability,



and cloud costsRequired Qualifications5-8+ years of Data Engineering experienceStrong hands-on experience with Azure, Databricks, PySpark, and Unity CatalogAdvanced proficiency in SQL and PythonExperience supporting customer/guest data domains and customer-centric data platformsExperience working with structured and semi-structured data, including NoSQL databases (Cosmos DB preferred)Strong understanding of Data Governance, Data Quality, and Data Observability best practicesProven experience building and maintaining large-scale ETL/ELT pipelines and cloud-based data lakesExperience with CI/CD, Terraform, and Infrastructure-as-Code practicesExperience contributing to architecture decisions and mentoring junior engineersPreferred QualificationsRetail, e-commerce, loyalty, or customer data platform experienceExperience with Spark Declarative Pipelines and Metric Views in DatabricksExperience supporting Machine Learning or AI-enabled data productsUnderstanding of Data Mesh architecture and domain-oriented data productsAWS experienceExperience with real-time streaming and event-driven architecturesExpand and evolve the Guest Data Lake to support new digital and customer experience initiativesDesign advanced data quality and observability frameworksSupport enterprise-wide data governance standards and implementation patternsImplement Data Mesh principles and domain-driven ownership modelsBuild automation and self-service capabilities for data infrastructure provisioningSupport real-time and event-driven data processing solutionsDeliver scalable personalization, customer analytics, and guest engagement capabilitiesOptimize cloud infrastructure for performance, scalability, reliability, and cost efficiency #J-18808-Ljbffr

📌 Senior Data Engineer (Vancouver)
🏢 Insight Global
📍 Vancouver