Elevate your career as a Senior Big Data Developer based in Toronto, ON, with a 4-day onsite work schedule. This contract role focuses on building scalable data pipelines and involves extensive API integration.
The ideal candidate will have expertise in Big Data Engineering, AI-assisted development, and will be responsible for designing and maintaining data systems in an enterprise setting. Proficiency in Spark-Scala, ETL optimization, and complex query writing are essential. You will also work on job orchestration using shell scripting and manage data extraction from APIs.
Key Responsibilities:
• Design Spark-Scala apps for data processing
• Build and optimize ETL/ELT pipelines
• Tune Spark jobs for performance optimization




• Migrate applications to Spark 3 on Cloudera CDP
• Write complex HiveQL queries for data retrieval
Requirements:
• Experience with big data tools and frameworks
• Proficiency in Unix/Shell scripting
• Skills in Python for API data extraction
• Familiarity with HDFS and data governance
• Understanding of AI tools for automation
Leverage your skills in big data technologies and make a meaningful impact on data engineering projects in Toronto.
J-18808-Ljbffr

📌 Senior Big Data Developer In Toronto
🏢 E-Solutions
📍 Toronto