08 Aug
|
Adastra
|
Ontario
Overview
Adastra is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and cloud-based data platforms that support advanced analytics, reporting, and AI initiatives. This role is responsible for developing high-performance ETL/ELT solutions using PySpark and modern data engineering technologies, enabling efficient processing of large-scale structured and semi-structured data across enterprise environments.
The ideal candidate is a hands-on data engineering professional with strong expertise in distributed data processing, cloud data platforms, and data pipeline orchestration. This individual will collaborate closely with data architects, data scientists, analysts, and business stakeholders to deliver reliable, scalable, and high-quality data solutions that drive business value and support data-driven decision-making.
Primary Location: Toronto, ON
Work Model: Hybrid 2-Days Onsite
Employment Type: Full time or Contractor
Vacancy Status: New
RESPONSIBILITIES
Design, develop, and maintain scalable ETL/ELT pipelines using PySpark for batch and near-real-time data processing
Develop and optimize Spark jobs using DataFrames, RDDs, and Spark SQL for large-scale data transformations and aggregations
Build reusable data ingestion frameworks to support integration from databases, APIs, flat files, and streaming sources
Optimize Spark application performance through partitioning, caching, broadcast joins, and cluster resource tuning
Collaborate with data scientists, analysts, and business stakeholders to deliver clean, curated datasets for reporting and advanced analytics
Implement automated data quality checks, validation rules, and monitoring processes to ensure data reliability
Develop and maintain workflow orchestration using Airflow, Oozie, or similar scheduling tools
Integrate data pipelines with cloud data lakes and data warehouse platforms such as Snowflake, Redshift, Delta Lake, S3, and HDFS
Troubleshoot and resolve pipeline failures, production issues, and distributed processing bottlenecks
Maintain technical documentation, version control, and deployment processes for data engineering solutions
Participate in code reviews, testing,
and CI/CD initiatives to improve solution quality and delivery efficiency
Support the continuous improvement of data engineering frameworks, standards, and best practices
QUALIFICATIONS, SKILLS & EXPERIENCE
Bachelor's degree in Computer Science, Engineering, Information Technology, Data Analytics, or a related field
5+ years of experience in Data Engineering, ETL/ELT development, or Big Data environments
3+ years of hands-on experience with PySpark and Apache Spark
Strong proficiency in Python and SQL
Experience building data platforms that support data science and machine learning workloads (Python, Anaconda)
Experience developing Spark applications using DataFrames, RDDs, and Spark SQL
Experience building and supporting enterprise-scale data pipelines and distributed data processing solutions
Hands-on experience with workflow orchestration tools such as Airflow, Oozie, or equivalent platforms
Experience working with cloud data lakes and data warehouse technologies including Snowflake, Redshift, Delta Lake, S3, or HDFS
Strong understanding of data modeling, data warehousing, and modern data architecture principles
Experience implementing data quality, validation, and monitoring frameworks
Familiarity with Git, version control processes, and CI/CD practices
Strong analytical, troubleshooting, and performance optimization skills
Experience working in Agile delivery environments
Excellent communication and collaboration skills
NICE TO HAVE
Experience with Databricks and Lakehouse architectures
Experience with AWS, Azure, or Google Cloud Platform
Experience with Kafka, Spark Structured Streaming, or real-time data processing technologies
Knowledge of Infrastructure as Code tools such as Terraform or CloudFormation
Experience supporting Machine Learning or AI data platforms
Experience in consulting, professional services, or client-facing environments
Industry experience within Financial Services, Retail, Healthcare, Telecommunications, Manufacturing, or Public Sector organizations
Experience with data governance, metadata management, and data catalog solutions
ABOUT ADASTRA
Adastra is a global leader in AI and data-driven transformation, helping organizations lead with artificial intelligence—responsibly, strategically, and at scale. With over 25 years of experience, Adastra empowers enterprise clients to unlock business value through data innovation, operational excellence, and smart customer engagement.
Trusted by some of the world’s most prominent brands, Adastra delivers end-to-end solutions grounded in thoughtful strategy, robust governance, and deep technical expertise. From defining vision to ensuring execution, Adastra guides organizations through every stage of their AI, data and cloud journey—building future-ready capabilities and delivering measurable, lasting impact.
Adastra serves clients across key industries including financial services, automotive, manufacturing, technology, media and telecom (TMT), healthcare, retail, and professional services. The company employs more than 2,000 professionals across North America, Europe, and Asia.
WHAT WE OFFER
Opportunity for advancement and career progression
Competitive compensation
Successful referral program
The opportunity to work with one of Canada’s 50 Best Managed Companies
Satisfaction of working for a reputable company
A flexible, dynamic, and diverse workplace
EQUAL OPPORTUNITY EMPLOYER
In our commitment to promote fair and equitable treatment of all employees and applicants, Adastra Corporation provides equal employment opportunities for all individuals regardless of age, sex, disability, race, ethnic origin, citizenship, creed, sexual orientation, marital status, or any other ground as described in the Ontario Human Rights Code.In addition, accommodation will be provided during the hiring process. Adastra Corporation’s implementation and support of employment initiatives, encourage diversified labour force participation and equal access to opportunities based on merit and performance.
#J-18808-Ljbffr
📌 Data Engineer (Ontario)
🏢 Adastra
📍 Ontario