17 Nov
|
Astra North Infoteck
|
Winnipeg
17 Nov
Astra North Infoteck
Winnipeg
Build GCP data migration solutions with PySpark and Salesforce APIs, focusing on Dataproc, BigQuery, and scalable ETL pipelines. This Data Migration Engineer role requires four to five years minimum of experience. You will use Python, Apache Spark, BigQuery, GCS, and Salesforce data models to support complex migrations. The work includes transformation, validation, reconciliation, and performance troubleshooting across 70-plus object schemas. Key Responsibilities:
Build ETL pipelines within the GCP ecosystem Develop Python transformations and business logic Debug Spark jobs and resolve memory issues Validate and reconcile migrated data using SQL Handle files through GCS storage patterns Requirements:
Four to five years minimum relevant experience Solid GCP Dataproc and Apache Spark experience Proficiency with BigQuery SQL and table optimization Salesforce API and data model understanding Comfort with complex schemas and relationships Apply PySpark, BigQuery, Salesforce, and GCP expertise to solve demanding data migration and validation challenges.
#J-18808-Ljbffr
📌 GCP PySpark Data Migration Engineer (Winnipeg)
🏢 Astra North Infoteck
📍 Winnipeg