12 Sep
|
Centraprise
|
Canada
12 Sep
Centraprise
Canada
Software Development Engineer in Test (SDET)
Location: Remote – Canada
Employment Type: Long-Term Contract
Position Overview
We are looking for a Software Development Engineer in Test (SDET) with a strong software development and coding background to design, develop, and automate testing solutions for data and ETL pipelines.
The ideal candidate should be hands-on with Python, SQL, AWS, PySpark, and automation frameworks, with experience building test automation rather than focusing only on manual QA.
Key Responsibilities
- Develop and maintain automated testing frameworks for data pipelines and ETL processes.
- Write robust and reusable automation scripts using Python, PySpark, and SQL.
- Design and execute automated tests for ETL, data quality, APIs, and data pipelines.
- Validate data transformations, mappings, and data integrity across systems.
- Work with AWS services including S3, Glue, and Data Lakes.
- Integrate automated testing into CI/CD pipelines using Jenkins and GitHub.
- Perform API, integration, regression, and data validation testing.
- Troubleshoot failures across application, data, and pipeline layers.
- Collaborate with developers and data engineers to improve code quality and test coverage.
- Apply TDD and structured test automation practices.
Required Technical Skills
- Robust software development/programming background, preferably with Python.
- Python, Pandas, PySpark
- Advanced SQL, including Window Functions and CASE statements.
- ETL testing and ETL automation.
- Informatica or similar ETL tools.
- AWS: Glue, S3, Data Lakes.
- Apache Spark, Kafka, and Airflow
- ICEDQ / QuerySurge or similar data testing tools.
- API testing and automation.
- GitHub and Jenkins
- Shell scripting and Unix/Linux command line.
- Strong understanding of software testing techniques and test design.
Preferred Qualifications
- Experience developing automation frameworks from the ground up.
- Experience testing large-scale data pipelines and distributed data systems.
- Strong understanding of CI/CD and DevOps practices.
- Experience working in Agile/Scrum environments.
- Ability to troubleshoot and analyze complex data and application issues.
Ideal Candidate Profile We are primarily looking for an SDET / Software Engineer with strong development experience, not a traditional manual QA profile. Candidates should be comfortable writing production-quality code and building automated testing solutions for data, ETL, and cloud-based applications.
📌 Software Development Engineer in Test (SDET) (Canada)
🏢 Centraprise
📍 Canada