21 Sep
|
Socket.dev
|
Ontario
21 Sep
Socket.dev
Ontario
About Citco
Armed with superior services, smart people, and strong technology, we tackle our customers’ complicated challenges by developing sophisticated solutions driven directly by their demands. The result? Innovation that generates tangible value and makes a real difference for our clients and their companies.
Citco is a global leader in financial services, delivering innovative solutions to some of the world's largest institutional clients. We are seeking a Test Engineer specializing in Data and data platforms (Databricks) to ensure the quality and reliability of our data solutions.
Responsibilities
About the Role
As a Test Engineer - Data, you will be responsible for developing and implementing automated testing frameworks for Databricks-based solutions, data pipelines, and data quality validation. You will work closely with data engineering teams to ensure data accuracy and reliability across our Lakehouse architecture.
Key Responsibilities
Data Pipeline Testing
Automate testing for ETL/ELT processes in Databricks
Implement Spark job testing and optimization validation
Create test cases for data ingestion and processing workflows
Develop automated checks for data transformations
Test Unity Catalog features and access controls
Databricks Testing
Design and implement automated testing for Databricks notebooks and workflows
Create test frameworks for Delta Lake tables and ACID transactions
Develop automated validation for structured streaming pipelines
Validate Delta Live Tables implementations
Quality Assurance
Design and execute data quality test strategies
Implement automated data reconciliation processes
Develop performance testing for large-scale Spark jobs
Monitoring & Reporting
Implement pipeline monitoring test frameworks
Create automated test dashboards
Generate quality metrics and testing reports
Maintain comprehensive test documentation
Qualifications
About You
Educational Background
Bachelor’s degree in Computer Science, Data Science, or related field
Relevant certifications in Databricks or data testing are a plus
Technical Experience
2+ years hands-on experience with Databricks (Spark)
Strong programming skills in Python (PySpark) and SQL
Experience with data testing frameworks and tools
Proficiency with AI coding agents such as Claude Code, Cursor, Kiro
Knowledge of AWS services (S3, Glue, Lambda)
Understanding of Delta Lake and Lakehouse architecture
Experience with version control systems (Git)
Additional Skills
Solid analytical and problem-solving abilities
Experience with large-scale data processing
Knowledge of data quality best practices
Understanding of data governance and compliance requirements
Experience with Agile methodologies
Platform Knowledge
Databricks workspace and notebook development
Delta Lake and Delta Live Tables
Unity Catalog for governance testing
Spark optimization and performance testing
Salary Range: CAD $105,000 to CAD $135,000
This posting is for an existing vacancy.
Our Benefits
Your well being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.
We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.
Citco welcomes and encourages applications from people with disabilities. Accommodations are available upon request for candidates taking part in all aspects of the selection.
#J-18808-Ljbffr
📌 Test Engineer - Data (Ontario)
🏢 Socket.dev
📍 Ontario