19 Nov
|
KPI Digital Solutions
|
Winnipeg
19 Nov
KPI Digital Solutions
Winnipeg
About KPIKPI Digital helps clients reach their business objectives by identifying required capabilities and by providing the proper data and analytics strategy and foundation allowing handling of all data challenges including enterprise-wide AI scaling. We specialize in Data & Analytics from Strategy, Architecture, Governance, Modern D&A; Platform, MDM and the entire D&A; Value Chain (Data Ingestion, Data Pipelines, Lakehouse, AI Modeling, DO/OR, BI, Deployment and Monitoring.
Data Engineer – Data & Analytics GroupAbout KPIKPI Digital helps clients reach their business objectives by identifying required capabilities and by providing the proper data and analytics strategy and foundation allowing handling of all data challenges including enterprise-wide AI scaling. We specialize in Data & Analytics from Strategy, Architecture, Governance, Contemporary D&A; Platform, MDM and the entire D&A; Value Chain (Data Ingestion, Data Pipelines, Lakehouse, AI Modeling, DO/OR, BI, Deployment and Monitoring.
Performance Management and Digital Experience are two additional practices that complement the D&A; practice. In addition, to the Consulting Services,
we offer
Managed Services, Education and Training. Want to join a winning team?The RoleWe are looking for a Data Engineer that combines Data Engineering, platform architecture and management expertise. The Data Engineer will:Provide consulting services to our customers as the KPI Digital Lead Data EngineerDefine and maintain the KPI Digital Modern D&A; Platform Architecture. This D&A; Platform Architecture must:Support real-time LakeHouse Architecture on Azure, AWS and GCPData feeds from business applications and sensors, IoT, PLC, ScadaAny type of workload from API on Insights, BI, AI ML/DL, NLP, DO/OR, Execution of ML models in real-time, batches,
micro-batches or on edgeData Ingestion in batch, micro-batches and streamingReal-time dashboardRespect highest security standardsScalable, elastic and performantMaintain AND Improve Accelerators to speed up the creation of Data Pipelines on major cloud providersParticipate and support the AI Pre-Sales activitiesBuild a Data Engineering team to meet the expected customers growthCreate Data Engineering content (articles, white papers and so on)Speak in conferences, webinars to promote KPI Digital brandThe Ideal Candidate IsGoal oriented and possesses strong decision-making and problem-solving skillsAble to build a team of diverse talents to meet the customers expectations. This implies being quite involved in the recruiting and the active management of all Data Engineers (coaching, guiding, evaluating, setting objectives, reviews and so on)Expected to work in close collaboration with the AI Team Lead, the Data Governance Lead and the VP of D&AA; team lead, which means he/she not only assists his/her team, but the candidate is also responsible to bring his/her team to higher level of expertiseAble to devise training programs around the consulting mandates for his/her team to growCommunicates and explains the plan, templates, approaches to his/her team and other teams so that he/she does not end-up being a bottleneckCan communicate clearly in both languages (French and English)
going technical when appropriate and is able to elevate the vocabulary for less technical folks such as clients, other team members, PM and so onExcellent written and verbal communication skills for coordinating across teams (French and English)Ability to discern fundamental and key aspects worth ‘fighting for’ versus the less ‘important’ ones. The ideal candidate is ‘street smart’Work with our customers’ stakeholders to identify opportunities for leveraging their existing D&A; platform toward a modern real-time LakeHouseCoordinate with different functional teams to implement all D&A; assets with proper monitoringKeep up to date with various modern D&A; platform services and trendsSpecific SkillsHas implemented Lambda Architecture (may also have implemented KAPPA). And could create templates for a team of Data EngineersUnderstands and did implement how to move data from Event Hub (or similar) to a raw zone, then an integrated zone and then to a consumption zone with replication to a Serving Layer with database like Synapse, Snowflake, BigQuery or Redshift (micro batches and streaming even in the cold layer)Has been implementing the main 3 types of slowly changing dimensions in this technology or older onesHas Data Engineering using DataVaultHas used Delta LakeKnows how to stream data in the Data Lake using DatabricksIs very solid with Spark (to deal with Big Data situations) and can tune the environment using multiple nodes, is able to partition ‘DB’ and understand replicating the dimensions on multiple nodesCan optimize the use of Azure resources to optimize costs and usageHas some Azure administrator and cloud architecture experienceCan define the access rights management solutionIs an adept of CI-CD and can implement Azure DevOpsCan define real-time and batch orchestratio
📌 Senior Data Engineer (Winnipeg)
🏢 KPI Digital Solutions
📍 Winnipeg