Data Engineer to build and maintain data pipelines on the Databricks Lakehouse Platform for the financial services industry (Toronto)

Data Engineer to build and maintain data pipelines on the Databricks Lakehouse Platform for the financial services industry (Toronto)

16 Apr
|
S.i. Systèmes
|
Toronto

16 Apr

S.i. Systèmes

Toronto

We are looking for 2 Senior Data Engineers and 1 Data Engineer to build and maintain data pipelines on the Databricks Lakehouse Platform for the financial services industry

Full Time Permanent Role

3 times a week on site (Near King Station)

Salary Range: $115,000-$140,000/year

Must Haves Skills:

- Bachelor’s degree in computer science, Engineering, or related field
- 5-7 years of experience in data engineering
- 3+ years of hands-on experience with Databricks platform
- Robust programming skills in Python
- Experience with Spark and distributed computing
- Working knowledge of AWS services (S3, Glue, Lambda)
- Experience with Delta Lake and Lakehouse architecture
- Familiarity with data modelling and SQL
- Understanding of ETL/ELT principles and patterns
- Experience with version control systems (Git)
- Experience with CI/CD for data pipelines
- Familiarity with Agile development methodologies
- Experience with real-time data processing is a plus

Nice to Haves:

- AI/ML

Job Duties in Brief:





- Participate and contribute on all team activities such as Sprint Planning, Sprint Execution, Daily Scrum
- Develop and maintain data pipelines using Databricks Lakehouse and Delta Lake
- Implement ETL/ELT workflows using Spark (Python) in Databricks environment
- Work with AWS services (S3, Glue) for data lake storage and catalog management
- Create and optimize Spark jobs for efficient data processing and cost management
- Build and maintain data quality checks and monitoring systems
- Configure and manage Databricks notebooks and jobs
- Implement proper security and access controls using Unity Catalog
- Participate in code reviews and documentation efforts
- Stay current with Databricks features and data engineering best practices
- Support real-time data processing using structured streaming when required

Disclaimer:
AI may be used in evaluating candidates.
This posting is for an existing vacancy.

Apply

📌 Data Engineer to build and maintain data pipelines on the Databricks Lakehouse Platform for the financial services industry (Toronto)
🏢 S.i. Systèmes
📍 Toronto

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: data engineer to build and maintain data pipelines on the databricks lakehouse platform for the financial services industry (toronto) / toronto
Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: data engineer to build and maintain data pipelines on the databricks lakehouse platform for the financial services industry (toronto) / toronto