21 Nov
|
Teqfocus
|
Toronto
Build scalable data integration solutions with Databricks and PySpark at Teqfocus, using SQL and Python to process enterprise data. Work hands-on across Delta Lake and master data ingestion workflows.
Teqfocus seeks a Data Engineer with five or more years of qualified experience in data engineering, data integration, or ETL/ELT development. You will transform structured datasets into complex nested JSON payloads, integrate platforms through REST APIs, and support accurate ingestion into Reltio MDM. The work includes bulk and incremental pipelines, source-to-target mapping, validation, reconciliation, and troubleshooting. Strong SQL skills and collaboration across engineering and business teams are required.
Key Responsibilities:
- Process Delta Lake tables and data layers using PySpark and SQL
- Develop Python transformations for nested JSON payloads
- Integrate platforms through authenticated REST APIs
- Support Reltio entities, attributes, relationships, and ingestion
- Maintain validated bulk and incremental ETL/ELT pipelines
Requirements:
- Five or more years in data engineering or ETL/ELT development
- Hands-on Databricks, PySpark, SQL, and Python experience
- Experience creating complex JSON from structured datasets
- Practical REST API authentication, error, and retry experience
- Hands-on knowledge of Reltio MDM data models
Apply Databricks, PySpark, Python, and SQL expertise to reliable Reltio MDM data integration at Teqfocus.
#J-18808-Ljbffr
📌 Databricks PySpark Data Engineer (Toronto)
🏢 Teqfocus
📍 Toronto