Join a leading firm as a DataBricks Engineer, specializing in the migration of legacy platforms to contemporary architectures. This role demands strong technical expertise in finance and risk data models.
With 12–18 years in data engineering and over 5 years of practical experience with Databricks and Spark, you'll focus on redesigning data processes and ensuring both integrity and efficiency. Your ability to refactor Hive and Impala logic into PySpark will facilitate a seamless migration to a cloud-oriented setup, transforming how data is ingested and utilized.
Key Responsibilities:
• Modernize Cloudera platforms to Databricks architecture
• Build scalable data pipelines with PySpark and Delta Lake




• Redesign consumption patterns for data reporting
• Ensure data reconciliation and audit integrity
• Act as a lead technical authority, mentoring engineers
Requirements:
• 12-18 years in data engineering roles
• Expertise in enterprise Data Warehouse and Data Lakes
• Experience with financial data models and compliance
• Familiarity with AWS or Azure environments
• Understanding of CI/CD practices and tools
Shape the data landscape by utilizing your extensive skills in Databricks and financial systems.
#J-18808-Ljbffr

📌 DataBricks Engineer Driving Transformation (Toronto)
🏢 PeoplePilot
📍 Toronto