29 Sep
|
VySystems
|
Canada
Role Overview
We are seeking a Senior Data Engineer with strong Quality Engineering (SDET) experience. The role is primarily focused on building and validating data solutions using Databricks, Python, and Azure cloud technologies, while also owning automated testing, end-to-end validation, and quality assurance across data pipelines, APIs, and backend systems.
Key Responsibilities & Requirements:
- 8+ years of experience in Data Engineering, SDET, or Quality Engineering.
- Robust hands-on experience with Databricks and PySpark.
- Develop and validate data pipelines and ETL/ELT processes.
- Implement data quality and data validation practices.
- Perform REST API test automation using Karate or similar tools.
- Strong expertise in end-to-end testing.
- Experience with Microsoft Azure.
- Knowledge of Kafka and asynchronous backend testing.
- Experience with Databricks testing and data validation frameworks.
📌 Software Tester (Canada)
🏢 VySystems
📍 Canada