04 Sep
|
Cloud Data Vision
|
Canada
04 Sep
Cloud Data Vision
Canada
:
Senior AWS Data Engineer, GA4 Silver/Gold Layer
Location:
Remote, Eastern Time overlap required
Mission
Take raw GA4 clickstream data landing in Porter's S3 Bronze layer and build the flattened, domain-aligned silver and gold layers in Redshift that BI (Tableau, Power BI) and AI/RAG consumers will run against. Ship production tables, not prototypes.
What you will do
·
Build transformation pipelines (Matillion, Python, or AWS Glue) that unpack nested GA4 struct and array fields into flat, queryable columns
·
Design and deliver wide, denormalized, domain-aligned silver tables such as silver shopping and silver order, prioritizing BI query performance over normalization purity
·
Layer Gold-tier aggregates on top of Silver for reporting and AI consumption
·
Implement column-level PII controls in Lake Formation with distinct access classes for BI, AI, and Data Science
·
Deploy late-binding views in Redshift as the consumption abstraction for Tableau and Power BI, keeping raw S3 partitions out of end-user reach
·
Reconcile new GA4 data against Porter's existing legacy flyporter clickstream where it accelerates value
·
Document lineage, grain, and refresh cadence for every table you land
·
Partner with Troy on architectural decisions and hand off cleanly at end of engagement
Must-have experience
·
5+ years in data engineering with recent, hands-on production work on AWS (S3, Glue, Lake Formation, Redshift, Redshift Spectrum)
·
Direct experience flattening GA4 (or GA360) BigQuery-style nested exports into columnar analytics tables
·
Robust SQL and Python. Comfortable writing Glue jobs or Matillion transformations in production
·
Redshift performance tuning: dist keys, sort keys, late-binding views, workload management
·
Column-level security patterns in Lake Formation, and role-based access design across multiple consumer classes
·
Modeling judgment for wide domain tables serving BI and AI/RAG, not just classical Kimball
Nice to have
·
Airline, travel, or e-commerce clickstream experience
·
dbt or similar transformation framework exposure
·
Tableau and Power BI semantic layer awareness (what breaks BI tools when the schema is wrong)
·
Feeding vector stores or RAG pipelines from Redshift Gold tables
Success in the first 30 days
·
Silver layer live for at least one domain (shopping or order), populated from Bronze on schedule
·
PII access model reviewed and approved by Porter security
·
Late-binding views serving a real Tableau or Power BI report
📌 Senior AWS Data Engineer,Silver/Gold Layer (Canada)
🏢 Cloud Data Vision
📍 Canada