Big Data Engineer

We are seeking a seasoned and motivated Big Data Engineer to join our growing Enterprise Data and Advanced Analytics Platform team.

The ideal candidate is an expert data pipeline builder and data wrangler who thrives on optimizing data systems and architecting them from the ground up.

Location: Hybrid (2–3 days in office), Toronto, ON.

Reports to: Senior Manager, Data & Analytics & Enterprise Data Architect.

Responsibilities

- Architect & maintain pipelines: design, construct, and manage robust, large‑scale, and efficient data pipeline architectures to meet complex functional and non‑functional business requirements.
- Process optimization: drive continuous internal process improvements by automating manual tasks, optimizing data delivery, and redesigning infrastructure for enhanced scalability and performance.
- Cloud infrastructure management: administer and manage a comprehensive suite of AWS services, including S3, RDS, EC2, EMR, VPC, Security Groups, CloudFormation, CloudWatch, Managed Airflow, and SNS.
- Data ingestion & ETL: develop optimal infrastructure for Extract, Transform, and Load (ETL) operations from disparate data sources using SQL and AWS ‘big data’ technologies, with a focus on both bulk and streaming data.
- Engineering excellence: adhere to development best practices, ensuring meticulous code management, branching, and merging within GIT repositories.
- Operational support: provide on‑call and off‑business hours support on a rotational basis to ensure system reliability.
- Collaboration & mentorship:



act as an effective team player and mentor to junior staff through technical reviews and brainstorming sessions, while expertly managing stakeholder expectations and inquiries.

Qualifications – Must Have

- Education: University degree, college diploma, or equivalent experience in Computer Science, Statistics, or Mathematics.
- Experience: 5–8 years of overall IT experience, with 4+ years specifically focused on Big Data technologies (Spark, Hive, Presto, etc.).
- AWS expertise: strong technical proficiency in AWS cloud technologies, specifically S3, EC2, and EMR.
- Data platforms: proven experience working with Snowflake.
- Programming: proficiency in Python, Scala, Shell scripting, or Java.
- Data modeling: solid understanding of data warehousing and data modeling techniques.
- Performance tuning: hands‑on experience in performance tuning for Spark jobs and Hive tables.
- Agile delivery: experience working within Agile development methodologies.
- Soft skills: meticulous attention to detail, excellent analytical problem‑solving skills, and superior interpersonal communication abilities.

Qualifications – Nice to Have

- Domain knowledge: good understanding of the Equity Markets business.
- DevOps tools: experience with Terraform or Ansible.
- Streaming: experience with Kafka.
- Machine learning: experience designing technology stacks tailored for machine learning.
- Strategic mindset: ability to multitask in a fast‑paced setting.

Compensation

Salary Range: CAD 100,000 – 120,000 per year.

Legal Notice

Applicants must be authorized to work in Canada. TMX is not currently sponsoring work permit applications.

#J-18808-Ljbffr

📌 Big Data Engineer (Toronto)
🏢 TMX Group
📍 Toronto