Apply on Kit Job: kitjob.ca/job/2g9hym

Seeking a skilled Data Engineer with expertise in Apache Spark and programming languages like Python and Scala. Focus on building high-performance data pipelines and processing large datasets in a distributed environment.
This hands-on role is essential for developing production-grade Spark applications running on Azure Databricks. You'll design, maintain, and optimize scalable data pipelines, ensuring high performance and reliability. Collaboration with analytics and data science teams is crucial to support varying downstream use cases.
Key Responsibilities:
• Design and develop large-scale Spark applications
• Optimize batch and streaming data pipeline performance
• Write efficient, production-quality Spark code




• Troubleshoot Spark job failures and performance issues
• Collaborate with cross-functional teams for data usage
Requirements:
• 3+ years as a Data Engineer or similar
• Proficiency in Apache Spark and programming languages
• Solid SQL experience for data transformation
• Understanding of distributed systems and data processing
• Familiarity with cloud data platforms and orchestration tools
Advance enterprise analytics by building and maintaining robust data pipelines with robust performance in a collaborative setting.
#J-18808-Ljbffr

Apply on Kit Job: kitjob.ca/job/2g9hym

📌 Apache Spark Data Engineer Role (Toronto)
🏢 Scotiabank
📍 Toronto