Shape Apache Flink infrastructure at Shopify while solving distributed systems challenges across streaming and batch data processing platforms.
As a Staff Engineer, you will guide Shopify’s Streaming Compute platform at significant scale. Your work spans Apache Flink internals, developer experience, performance, reliability, and cost-productive operations. You will support pipelines powering recommendations, catalog, analytics, and core products.
Key Responsibilities
Shape technical direction for the Streaming Compute platformDebug and tune Apache Flink at engine levelImprove pipeline development, performance,
and platform reliabilityDrive cross-team initiatives from ambiguous problems to shipped outcomesContribute to Flink and its open source ecosystemRequirements:
Established Apache Flink expertise from production operation at scaleUnderstanding of runtime, state, checkpointing, memory, and connectorsStrong distributed systems fundamentals across stream and batch processingExperience with Kubernetes and data infrastructure resource managementAbility to mentor senior engineers and lead through influenceBring Apache Flink expertise, distributed systems depth, and technical leadership to Shopify’s Streaming Compute platform.