16 Sep
|
Compass Group Canada
|
Toronto
16 Sep
Compass Group Canada
Toronto
THE ROLE
We are looking for a Data Engineer to join our Data Technology team and help build and maintain scalable data pipelines and APIs. You’ll work with a up-to-date technology stack and collaborate closely with internal and external stakeholders, Data Scientists, and Analytic Engineers to deliver reliable, scalable data solutions.
WHAT YOU'LL DO
Design, build, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, Spark that hosted in AWS workplace.
Build and maintain Airflow DAGs, ensuring pipeline reliability and performance.
Develop and maintain data APIs and integrations across a variety of data sources.
Work with EMR, Iceberg, and Snowflake to support modern data processing and analytics.
Ensure data quality, observability, and monitoring across pipelines using tools such as Secoda.
Implement data quality checks and monitoring to identify and resolve data issues proactively.
Prototype and evaluate new technologies that unlock innovative data-driven consumer experiences.
Support stakeholders with data-related technical issues and needs.
Experience with Docker, Kubernetes, Spark, Snowflake, CI/CD a bonus
WHAT YOU'LL BRING
3–5 years of experience in Data Engineering or a similar role.
Strong programming skills in Python and SQL.
Hands-on experience with AWS, Lambda, Airflow, and Spark.
Experience with Iceberg, EMR, and Snowflake is preferred.
Strong understanding of data pipelines, data quality, monitoring, and scalable data architectures.
Bachelor's degree or equivalent experience in Computer Science, Computer Engineering, Information Systems, or a related field.
Strong communication skills, a collaborative mindset, and a willingness to learn.
GOOD TO HAVE
Experience with Docker and Kubernetes.
Experience with real-time/streaming technologies, such as Kafka, Kinesis
Experience with data observability and quality tools, such as Secoda, Data Dog.
Experience with CI/CD and contemporary software development practices.
ROLE DETAILS:
Full Time Permanent
4 in Office Days a Week
Salary: 100,000.00 - 120,000.00
Perks: Bonus, Benefits as of Day 1, 4 weeks of vacation, RRSP Match and more!
Location: 1 Prologis Blvd, Mississauga / 72 Fraser Avenue, Toronto
📌 Data Engineer Toronto
🏢 Compass Group Canada
📍 Toronto