Lead Databricks migrations with Python, PySpark, and SQL from a hybrid Toronto engagement. Modernize production pipelines for two-week Agile delivery.
This senior data engineering contract spans two months and focuses on migrating existing ETL/ELT workloads into Databricks. You will refactor processing logic, build scalable pipelines, and maintain ingestion, transformation, and metric calculations. The work includes Airflow orchestration, source-to-target mappings, testing, reconciliation, and production transition activities.

Key Responsibilities

Migrate and refactor ETL/ELT pipelines into DatabricksDevelop production pipelines using Python, PySpark,



and SQLModernize scheduled jobs and Airflow DAG-based processingImplement reusable patterns for additional workload migrationsSupport deployment readiness and production-transition activitiesRequirements:
Seven or more years in data or software engineeringStrong hands-on Databricks production experienceAdvanced Python, PySpark, Apache Spark, and SQL skillsExperience migrating legacy pipelines to up-to-date cloud platformsGreater Toronto Area residence and downtown onsite availabilityApply senior Databricks engineering expertise to modernize pipelines through Python, PySpark, SQL, orchestration, and migration delivery.
#J-18808-Ljbffr

📌 Senior Databricks Migration Engineer (Winnipeg)
🏢 Ian Martin Group
📍 Winnipeg