19 Nov
|
Datastore
|
Toronto
Join datastore in building reliable data pipelines that decode years of on-chain history into trustworthy Parquet files for researchers. Elevate data correctness and infrastructure while ensuring high quality and accuracy.As a Data Engineer, you will design and run large-scale decoding pipelines, focusing on Solana and Hyperliquid history. This role demands significant experience in building production data pipelines, emphasizing SQL alongside either Python, Rust, or Go. You'll ensure correctness through rigorous validation, checksums, and lineage documentation,
addressing customer inquiries about schemas and coverage.Key Responsibilities:Design and implement backfill pipelines at scaleModel typed schemas for various protocolsBuild validation systems for data correctnessMaintain accurate versioning and documentationOptimize storage layout for quick query performanceRequirements:Proven experience in production data pipeline developmentProficiency in SQL plus Python, Rust, or GoFamiliarity with Parquet and tools like DuckDBStrong focus on data correctness and validationWillingness to work part-time in Toronto officeHelp create a reliable data pipeline that researchers can trust, ensuring high-quality deliveries every time.#J-18808-Ljbffr
📌 Data Engineer For On-Chain Pipelines - Part Time (Toronto)
🏢 Datastore
📍 Toronto