Role:-Senior Data Engineer

Location:-Remote

Duration:-6+ Months

Key Responsibilities:-

Ingestion & Openflow pipelines — Build and configure Openflow (managed NiFi) flows to ingest UKG ECM document extracts and metadata into the Snowflake landing zone, using parameterised source connections, schema validation, routing, prioritisation, back-pressure, retry handling, provenance and restartable execution across Dev/Test/Prod.

- Snowflake transformation — Develop Snowflake-native transformation logic (SQL, streams, tasks, MERGE patterns, effective-dated logic) to normalise, de-duplicate to golden record, and map legacy categories and document types to Workday EDM metadata standards. [
- Data quality, profiling & reconciliation — Implement source-to-target validation, reconciliation reports (counts, category coverage, null/mandatory-field checks) and exception reporting, flagging remediation items back to SA Recycling per the SOW mandatory-field requirements. [
- Workday load packaging — Produce Workday/EDM-compliant output bundles (manifest + ZIP, ?2GB, file-size and file-type compliance per Workday allowlist) with full audit logs and lineage.
- Category-based delivery — Execute category-by-category development (Categories 1–80 per the estimate model), delivering iterative test loads (initial 20K-document subset, then a wider-coverage 20K subset).
- Secure setting operation. Run pipelines within the provisioned VDI/VM (4-core, 32GB, Windows) with controlled access to Snowflake,



keeping credentials, data movement and processing fully governed and auditable within the client's infrastructure. [
- Enablement & knowledge transfer: Support demos, walkthroughs and a client enablement session on the accelerator and the UKG to Workday migration flow

Required Skills & Experience

- Proven senior data-engineering experience on enterprise/HCM data migrations (Workday, UKG, SAP, Oracle, PeopleSoft) with regulated/confidential data.
- Deep, hands-on Snowflake (SQL, streams, tasks, dynamic tables, warehouse tuning, RBAC) and Snowflake Openflow / Apache NiFi flow design for structured and unstructured data ingestion.
- Strong Python and SQL for transformation, automation and reconciliation scripting.
- Experience with document/metadata migration, de-duplication to golden record, and mapping to target metadata standards (Workday EDM).
- Solid grounding in data governance, auditability, RBAC, lineage and reconciliation — able to design rework out of the flow and evidence 99%+ migration success.
- Secure-by-design mindset: SFTP/secure file handling, encryption, and controlled VM/VDI operation.

Desirable

- Exposure to Snowflake Cortex AI for metadata intelligence, anomaly detection and unstructured-document processing.
- Familiarity with UKG ECM / Document Manager extraction and Workday tenant load processes.

CI/CD (Git, Azure DevOps) and dbt for downstream transformation orchestration

📌 Senior Data Engineer (Canada)
🏢 Amtex Systems
📍 Canada