- Client is seeking a data engineer contractor to join our growing analytics team.

- We are seeking an experienced contract Data Engineer to design and build scalable data pipelines for structured and unstructured data across AWS and Google Cloud.

- This role will develop and maintain our cloud-based data architecture, including Apache Iceberg tables on AWS S3 and Glue, data delivery to Google BigQuery, and AI agents built with Google ADK and Agent Studio. The role is also responsible for troubleshooting and resolving complex issues in production systems, ensuring minimal downtime and optimal performance.

- The ideal candidate is detail oriented, comfortable working with large, high-frequency data sets, and able to deliver independently.

- They bring a problem solving mindset, clear documentation habits, the ability to collaborate closely with our business team, and drive to optimize data processes.

Key Responsibilities:

- Design, build, and maintain scalable data pipelines for structured and unstructured data across AWS and Google Cloud, using Python, SQL, and Apache Airflow

- Build and manage Apache Iceberg tables on AWS S3 with AWS Glue, and deliver data to Google BigQuery for downstream analytics and agent use

- Build curated business tables for structured data to support reporting, analytics, and AI agents

- Integrate REST APIs for data ingestion and external system connectivity

- Build, deploy, and maintain Google agents using Google ADK and Agent Studio

- Work with large data sets and high-frequency data, optimizing pipelines for performance, reliability, and cost

- Apply cloud architecture best practices and CI/CD practices for testing, deployment, and version control





- Configure and manage Google IAM permissions to support secure, least-privilege access

- Document architecture components, workflows, and technical decisions to support transparency and knowledge sharing

- Monitor and troubleshoot pipeline performance and failures using logging and observability tools

Qualifications:

- Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related fields

- 3+ years of experience in data engineering, including cloud-based pipeline development

- Experience with AWS S3 and AWS Glue, including building and maintaining Apache Iceberg tables

- Experience with Google Cloud services, including BigQuery and Google IAM permissions

- Experience building and maintaining agents with Google ADK and Agent Studio

- Proficient in Python and SQL, with experience in PostgreSQL

- Experience with workflow orchestration using Apache Airflow

- Knowledge of storing and retrieving structured and unstructured data at scale

- Knowledge of REST APIs and authentication (OAuth2, key pair authentication)

- Knowledge of cloud architecture and CI/CD practices

- Solid documentation and communication skills; able to work independently in a contract capacity

Technical Stack & Collaboration:

- Technical Stack

- Primary Tools & Technologies:

- Python

- Snowflake (Tasks, UDFs)

- Google BigQuery

- AWS Glue

- ServiceNow REST API

- Airflow

- Preferred Experience:

- Minimum 2+ years in data engineering

- AI Integration

- Importance: High priority — candidates must have working knowledge of AI endpoints and automation.

- Team Collaboration

- Team Structure: This role will be part of a larger data and analytics team

📌 Data Engineer (Canada)
🏢 SGS Consulting
📍 Canada