04 Oct
|
D8 LooP
|
Ontario
Faire · boards.greenhouse.io · checked today
Faire is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe.
Skills, with evidence Airflow / orchestration Experience operating Airflow at scale and working with managed ingestion like Fivetran. must have
Experience with data quality and observability in practice, including data contracts, SLAs, and tools like Anomalo or Monte Carlo. must have
Idempotency & backfills You'll be responsible for the hard details like ordering, deduplication, late data, schema changes, and backfills. must have
Python Solid Python plus at least one of Kotlin, Java, Scala, or Go. must have
SQL Solid SQL, and good instincts for how to model data so analysts and data scientists can actually use it. must have
You know what goes wrong with ordering, duplicates, snapshots, and schema evolution because you've dealt with it. must have
Spark Strong Spark skills, and experience running Databricks and Snowflake against shared storage. must have
Streaming Deep experience with change data capture and streaming ingestion from operational databases through Kafka. must have
AWS Experience shipping infrastructure on AWS with Terraform. must have · not practised here
Terraform Experience shipping infrastructure on AWS with Terraform. must have · not practised here
Warehousing Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
Own reliability for the platform: SLOs, on-call, incident reviews, and the follow-through so the same thing doesn't break twice.
Incremental loads Build the CDC and streaming ingestion layer: CockroachDB changefeeds and MySQL binlogs into Kafka, then into Iceberg tables on S3.
Machine learning At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. not practised here
#J-18808-Ljbffr
📌 Staff Data Infrastructure Engineer Staff (Ontario)
🏢 D8 LooP
📍 Ontario