20 Nov
|
Astra North Infoteck
|
Toronto
20 Nov
Astra North Infoteck
Toronto
Build scalable GCP data platforms with BigQuery and Dataflow as a Senior Data Engineer focused on distributed processing. Apply six to eight years of experience to enterprise workloads.
This Senior Data Engineer designs, builds, optimizes, and maintains cloud-native data architectures. The work spans BigQuery, Dataflow, DataProc, Dataform, Cloud Composer, PySpark, and ELT/ETL frameworks. You will support data lakes, data marts, warehouse models, batch pipelines, streaming pipelines, and analytical platforms.
Key Responsibilities:
- Design end-to-end GCP data architectures and warehouse models
- Build scalable batch and streaming pipelines with Dataflow
- Develop optimized analytical structures and materialized views in BigQuery
- Orchestrate ELT/ETL workflows using Dataform and Cloud Composer
- Support migration from Hadoop and on-premise workloads
Requirements:
- Six to eight years of required experience
- Hands-on expertise with BigQuery, Dataflow, and DataProc
- Solid Python, SQL, Java, and PySpark skills
- Experience with data modeling, warehousing, and streaming
- Knowledge of metadata, lineage, quality, and governance
Apply GCP architecture, BigQuery optimization, Dataflow pipelines, and ELT expertise to enterprise-grade analytical workloads.
📌 Senior Gcp Data Engineer Bigquery (Toronto)
🏢 Astra North Infoteck
📍 Toronto