27 Oct
|
Confiar Services
|
Toronto
27 Oct
Confiar Services
Toronto
Data Engineer – Azure Databricks / Data Modeling / Data Lineage
Location:
Toronto Canada Contract: Long-Term Contract Job Summary We are looking for a Data Engineer with solid hands-on experience in Azure Databricks, Data Modeling, Data Lineage, Metadata Management, and Data Engineering. The ideal candidate will help build scalable and standardized enterprise data lineage solutions by consolidating existing proof-of-concepts into production-ready platforms.
Key Responsibilities
• Develop and enhance scalable data engineering solutions using Azure Databricks.
• Design and implement conceptual, logical, and physical data models.
• Develop and maintain data lineage models and lineage metamodels.
• Transform existing data lineage POCs into standardized, enterprise-grade solutions.
• Work closely with Data Architects, Data Engineers, Data Governance, and Data Management teams.
• Define and implement enterprise data lineage standards, frameworks, and technical solutions.
• Support metadata management, data integration, lineage, and data governance initiatives.
• Analyze data flows across multiple platforms and document end-to-end lineage.
• Build scalable solutions for capturing, managing, and consuming technical and business metadata.
• Ensure data solutions follow enterprise architecture, governance, security, and quality standards.
• Troubleshoot data pipeline and lineage-related issues and improve solution performance.
• Contribute to modernization and standardization of enterprise data platforms. Required Skills
• Strong hands-on experience with Azure Databricks and modern data engineering.
• Strong knowledge of Data Modeling and enterprise data architecture concepts.
• Strong understanding of Data Lineage and Lineage Metamodels.
• Experience designing metadata and lineage solutions.
• Experience converting POCs/prototypes into scalable production solutions.
• Strong understanding of data platforms, metadata management, data integration, and data governance.
• Strong SQL and data transformation skills.
• Experience working with large-scale enterprise data environments.
• Strong communication and collaboration skills.
📌 Data Engineer – Azure Databricks (Toronto)
🏢 Confiar Services
📍 Toronto