22 Sep
|
The Citco Group
|
Ontario
22 Sep
The Citco Group
Ontario
Become a Test Engineer for Data Solutions at Citco, where your role centers on ensuring data quality through automated testing frameworks in Databricks. Collaborate with dedicated teams to reinforce data accuracy.
This position is pivotal in driving the integrity of our data solutions. You will implement a variety of automated testing processes to validate data pipelines and optimize our Lakehouse architecture. Seeking individuals with a solid background in data testing, Databricks, and programming to ensure best practices are met.
Key Responsibilities:
• Automate ETL/ELT testing and Spark job validations
• Create test cases for data ingestion workflows
• Execute data quality testing strategies and monitoring
• Generate quality metrics through automated dashboards
• Develop validation for Delta Live Tables and streaming pipelines
Requirements:
• Bachelor’s degree in Computer Science or a related field
• 2+ years of hands-on experience with Databricks
• Robust skills in Python (PySpark) and SQL
• Background in data quality methodologies and governance
• Proficient in AWS services for data processing
Contribute your expertise to improve Citco's cutting-edge data solutions.
#J-18808-Ljbffr
📌 Citco Test Engineer for Data Solutions (Ontario)
🏢 The Citco Group
📍 Ontario