13 Sep
|
Compass Group
|
Toronto
13 Sep
Compass Group
Toronto
THE ROLE
We are looking for a Data Engineer to join our Data Technology team and help build and maintain scalable data pipelines and APIs. You’ll work with a modern technology stack and collaborate closely with internal and external stakeholders, Data Scientists, and Analytic Engineers to deliver reliable, scalable data solutions.
WHAT YOU'LL DO
- Design, build, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, Spark that hosted in AWS workplace.
- Build and maintain Airflow DAGs, ensuring pipeline reliability and performance.
- Develop and maintain data APIs and integrations across a variety of data sources.
- Work with EMR, Iceberg, and Snowflake to support modern data processing and analytics.
- Ensure data quality, observability, and monitoring across pipelines using tools such as Secoda.
- Implement data quality checks and monitoring to identify and resolve data issues proactively.
- Prototype and evaluate new technologies that unlock innovative data-driven consumer experiences.
- Support stakeholders with data-related technical issues and needs.
- Experience with Docker, Kubernetes, Spark, Snowflake, CI/CD a bonus
WHAT YOU'LL BRING
- 3–5 years of experience in Data Engineering or a similar role.
- Strong programming skills in Python and SQL.
- Hands-on experience with AWS, Lambda, Airflow, and Spark.
- Experience with Iceberg, EMR, and Snowflake is preferred.
- Strong understanding of data pipelines, data quality, monitoring, and scalable data architectures.
- Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, Information Systems, or a related field.
- Strong communication skills, a collaborative mindset, and a willingness to learn.
GOOD TO HAVE
- Experience with Docker and Kubernetes.
- Experience with real-time/streaming technologies, such as Kafka, Kinesis
- Experience with data observability and quality tools, such as Secoda, Data Dog.
- Experience with CI/CD and modern software development practices.
ROLE DETAILS
- Full Time Permanent
- 4 in Office Days a Week
- Salary: 100,000.00 - 120,000.00
- Perks: Bonus, Perks as of Day 1, 4 weeks of vacation, RRSP Match and more!
- Location: 1 Prologis Blvd, Mississauga / 72 Fraser Avenue, Toronto
📌 Data Engineer (Toronto)
🏢 Compass Group
📍 Toronto