Job Title: Test Engineer – Data
Job ID: 90661

Location: Toronto, Ontario

Overview:
Our client provides specialist financial services to alternative investment customers and private clients worldwide. Continuous investment in learning means you will work with people who are among the best in the industry. This is an opportunity to excel in an environment that genuinely supports your personal and professional development. As a Test Engineer – Data, you will be responsible for developing and implementing automated testing frameworks for Databricks-based solutions, data pipelines, and data quality validation. You will work closely with data engineering teams to ensure data accuracy and reliability across our Lakehouse architecture.

What you will be doing:

Data Pipeline Testing

Automate testing for ETL/ELT processes in Databricks

Implement Spark job testing and optimization validation

Create test cases for data ingestion and processing workflows

Develop automated checks for data transformations

Test Unity Catalog features and access controls

Databricks Testing

Design and implement automated testing for Databricks notebooks and workflows

Create test frameworks for Delta Lake tables and ACID transactions

Develop automated validation for structured streaming pipelines

Validate Delta Live Tables implementations

Quality Assurance

Design and execute data quality test strategies

Implement automated data reconciliation processes





Develop performance testing for large-scale Spark jobs

Monitoring & Reporting

Implement pipeline monitoring test frameworks

Create automated test dashboards

Generate quality metrics and testing reports

Maintain comprehensive test documentation

What you must have:

Educational Background

Bachelor’s degree in Computer Science, Data Science, or related field

Relevant certifications in Databricks or data testing are a plus

Technical Experience

2+ years hands-on experience with Databricks (Spark)

Robust programming skills in Python (PySpark) and SQL

Experience with data testing frameworks and tools

Proficiency with AI coding agents such as Claude Code, Cursor, Kiro

Knowledge of AWS services (S3, Glue, Lambda)

Understanding of Delta Lake and Lakehouse architecture

Experience with version control systems (Git)

Additional Skills

Strong analytical and problem-solving abilities

Experience with large-scale data processing

Knowledge of data quality best practices

Understanding of data governance and compliance requirements

Experience with Agile methodologies

Platform Knowledge

Databricks workspace and notebook development

Delta Lake and Delta Live Tables

Unity Catalog for governance testing

Spark optimization and performance testing

Salary/Rate Range:
CAD $105,000 to CAD $135,000

Other Information:

Hybrid: 3 days/week onsite downtown Toronto

40 hour work week

#J-18808-Ljbffr

📌 Test Engineer – Data (Ontario)
🏢 TEEMA Group
📍 Ontario