25 Sep
|
The Citco Group
|
Canada
25 Sep
The Citco Group
Canada
Become a Test Engineer for Data Solutions at Citco, where your role centers on ensuring data quality through automated testing frameworks in Databricks. Collaborate with dedicated teams to reinforce data accuracy. This position is pivotal in driving the integrity of our data solutions.
You will implement a variety of automated testing processes to validate data pipelines and optimize our Lakehouse architecture. Seeking individuals with a solid background in data testing, Databricks, and programming to ensure best practices are met. Key Responsibilities:
Automate ETL/ELT testing and Spark job validations
Create test cases for data ingestion workflows
Execute data quality testing strategies and monitoring
Generate quality metrics through automated dashboards
Develop validation for Delta Live Tables and streaming pipelines Requirements:
Bachelor’s degree in Computer Science or a related field
2+ years of hands-on experience with Databricks
Robust skills in Python (PySpark) and SQL
Background in data quality methodologies and governance
Proficient in AWS services for data processing Contribute your expertise to improve Citco's cutting-edge data solutions.
📌 Citco Test Engineer For Data Solutions Toronto (Canada)
🏢 The Citco Group
📍 Canada