22 Nov
|
Electric Mind
|
Winnipeg
22 Nov
Electric Mind
Winnipeg
Build Python and PySpark data pipelines at Electric Mind, supporting a financial services platform across development, quality assurance, and user acceptance testing environments.
This developer role is available permanently or by contract. You will maintain Databricks pipelines using SQL, medallion architecture, and curated data models. Working alongside a senior engineer, you will write clean transform code, resolve issues, and learn Databricks internals while supporting reliable platform operations.
Key Responsibilities
Write PySpark transforms for silver and gold data layersApply Auto CDC and SCD Type 2 merge patternsQuery Unity Catalog using SQL warehousesDebug pipeline logs, schema drift, and data quality issuesMaintain tests, scripts,
documentation, and GitLab merge requestsRequirements: Strong Python fundamentals, including functions, modules, and basic object-oriented programmingDatabricks experience or willingness to learn quicklyApache Spark, PySpark, or solid SQL exposureWorking knowledge of joins, aggregations, and window functionsBasic Git workflow and methodical debugging skillsDevelop Python, PySpark, SQL, and Databricks expertise while improving financial services data pipelines at Electric Mind. #J-18808-Ljbffr
📌 Python Databricks Data Engineer (Winnipeg)
🏢 Electric Mind
📍 Winnipeg