Consultant - PySpark / Databricks Developer (Junior to Intermediate) (Winnipeg)

Consultant - PySpark / Databricks Developer (Junior to Intermediate) (Winnipeg)

26 Sep
|
Electric Mind
|
Winnipeg

26 Sep

Electric Mind

Winnipeg

AtElectric Mind,Engineeringis where strategy meets action. Our team helps organizations cut through complexity-aligning business ambition with technology execution to unlock real, lasting change.You’llwork alongside curious, driven people tackling high-impact challenges for everyone from scaling startups to global enterprises. Each engagement is different, pushing you to learn, adapt, and grow.

Electric Mind's Technology Practice brings together deep engineeringexpertise, modern delivery disciplines, and pragmatic architectural thinking to help clients execute complex, mission-critical transformation. We design and implement scalable, secure, high-impact technology solutions that accelerate business outcomes.

We are looking for both permeant and contract for this role.

We're looking for a developer to help build and maintain data pipelines on Databricks for a financial services / wealth management data platform. The platform ingests data from multiple source systems, transforms it through a medallion architecture (bronze - silver - gold) using PySpark, and publishes curated data to downstream consumers via file exports and Kafka. You'll work alongside a senior engineer, writing transform code, fixing pipeline issues, and helping keep the environment healthy across dev/qa/uat.

This is a good fit for someone with solid Python fundamentals and some Spark/SQL exposure who wants to grow into a data engineering specialist. You won't be expected to know Databricks internals on day one - you will be expected to learn fast, ask good questions, and write clean,

What You'll Work On

Writing and maintaining PySpark transforms (hand-written, not a generic framework) for silver and gold layer tables - things like customer, account, and transaction data models

Working with Lakeflow Declarative Pipelines (Databricks' current pipeline framework - successor to DLT) and Auto CDC / SCD Type 2 patterns for change-data-capture merges





Querying and validating data in Unity Catalog across environments (dev/qa/uat) using SQL warehouses

Debugging failed pipeline runs: reading pipeline event logs, tracing bad records, fixing schema drift or data quality issues

Maintaining reference/lookup tables and small utility scripts (PowerShell/Python) used to operate the platform

Writing and updating unit/integration tests for transform logic

Participating in code review, using Git feature branches and merge requests (GitLab)

Keeping documentation current when you change how something works

Must-Have Skills

Python - comfortable writing clean, readable code; understands functions, modules, basic OOP

Some exposure to Apache Spark / PySpark, or solid SQL skills plus a willingness to learn Spark quickly

Working knowledge of SQL (joins, aggregations, window functions)

Basic Git workflow: branches, commits, pull/merge requests

Comfortable reading other people's code and stack traces, and debugging methodically (not guess-and-check)

Nice-to-Have Skills

Direct experience with Databricks (notebooks, jobs, clusters, or SQL warehouses)

Familiarity with Delta Lake, medallion architecture (bronze/silver/gold), or CDC/SCD concepts

Exposure to Azure (this environment runs on Azure Databricks with Azure AD service principal auth)

Experience with Kafka or other streaming/event systems

Experience with CI/CD pipelines (this project uses GitLab CI)

Prior work in financial services or a regulated data environment

What Success Looks Like In The First 90 Days

Can independently pick up a small transform bug or enhancement ticket, make the change, test it,



and open a merge request

Comfortable running existing operational scripts to check pipeline status, query tables, and diagnose failures without hand-holding

Starting to take ownership of the Databricks environments and help write current transforms

About Electric Mind

Electric Mind is a fast-growing, AI-native advisory and digital engineering firm built for those who want to shape the future, not just watch it happen. We blend premium strategyexpertisewithcutting-edgeAI-centric engineering to solve complex, meaningful problems for industry-leading clients.

We pride ourselves on a high-touch delivery model and a culture that values diverse talent, innovation, and true client partnership - creating an workplace where your ideas matter and your impact is visible.

Ifyou’relooking for a place where you can grow fast, collaborate with exceptional teammates, and help build a company scaling its capabilities and global footprint at speed - Electric Mind is the place to ignite your career. The future is bright!

For more info on Electric Mind, check out our Careers Page and Instagram.

Electric Mind is committed to diversity in the workplace. We are an inclusive employer and welcome and encourage applications from all qualified candidates. Applicants' needs will be accommodated during our recruitment and selection process so please advise us if you require accommodation.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

📌 Consultant - PySpark / Databricks Developer (Junior to Intermediate) (Winnipeg)
🏢 Electric Mind
📍 Winnipeg

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: consultant - pyspark / databricks developer (junior to intermediate) (winnipeg) / winnipeg

Subscribe to this job alert:

Get the latest job offers by email for: consultant - pyspark / databricks developer (junior to intermediate) (winnipeg) / winnipeg