02 Sep
|
TSR Consulting
|
Mississauga
02 Sep
TSR Consulting
Mississauga
Join TSR's dynamic team as a Big Data Developer/Engineer focused on PySpark and Hadoop.
Your role will center on establishing robust, scalable data pipelines. With over five decades in workforce solutions, TSR is looking for a talented Big Data Developer/Engineer. The ideal candidate will be skilled in designing and optimizing large-scale data systems while utilizing advanced tools in the Hadoop ecosystem. You will drive real-time data workflows and contribute to high-impact projects for our global clients. Key Responsibilities:
- Maintain scalable data pipelines with PySpark
- Design solutions using Spark, Hive, and Sqoop
- Develop pipeline workflows for high availability
- Write complex SQL queries for data extraction
- Automate scheduling with shell scripting and Autosys
Requirements:
- 6-8 years of experience as a developer
- Mastery of Big Data processing and PySpark
- Knowledge of distributed systems and data flow
- Experience with SQL for data analysis
- Robust problem-solving and communication skills
Play an integral role in driving analytics forward at TSR through your expertise.
📌 Big Data Engineer Role at TSR (Mississauga)
🏢 TSR Consulting
📍 Mississauga