Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks. You will refactor processing logic, build scalable pipelines, and maintain ingestion, transformation, and metric calculations.

The work includes Airflow orchestration, source-to-target mappings, testing, reconciliation, and production transition activities.Key Responsibilities:

Migrate and refactor ETL/ELT pipelines into DatabricksDevelop production pipelines using Python, PySpark,



and SQLModernize scheduled jobs and Airflow DAG-based processingImplement reusable patterns for additional workload migrationsSupport deployment readiness and production-transition activitiesRequirements:

Seven or more years in data or software engineeringStrong hands-on Databricks production experienceAdvanced Python, PySpark, Apache Spark, and SQL skillsExperience migrating legacy pipelines to contemporary cloud platformsGreater Toronto Area residence and downtown onsite availabilityApply senior Databricks engineering expertise to modernize pipelines through Python, PySpark, SQL, orchestration, and migration delivery.

📌 Senior Databricks Migration Engineer (Winnipeg)
🏢 Raise - find a more meaningful working experience
📍 Winnipeg