18 Nov
|
Astra North Infoteck
|
Winnipeg
18 Nov
Astra North Infoteck
Winnipeg
Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines.
This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas.
Key Responsibilities
Build ETL pipelines within the GCP ecosystemDevelop Python transformations and business logicDebug Spark jobs and resolve memory issuesValidate and reconcile migrated data using SQLHandle files through GCS storage patternsRequirements:
Four to five years minimum relevant experienceStrong GCP Dataproc and Apache Spark experienceProficiency with BigQuery SQL and table optimizationSalesforce API and data model understandingComfort with complex schemas and relationshipsApply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
📌 Gcp Pyspark Data Migration Engineer (Winnipeg)
🏢 Astra North Infoteck
📍 Winnipeg