Role: Apache Spark - Development Lead

Location: Toronto, Canada (4 days WFO)

Job Type: Fulltime

Role Overview:

We are looking for a seasoned Development Lead to guide and mentor a high-performing engineering team. The ideal candidate will have strong hands-on expertise in Java, Scala, Apache Spark, and ETL batch frameworks, with proven leadership skills to drive end-to-end delivery of scalable data solutions.

Key Responsibilities:

- Lead a team of developers and data engineers in designing and implementing enterprise-grade solutions.
- Architect and oversee development of ETL batch pipelines using Spark and related frameworks.
- Provide technical leadership in Java/Scala programming for backend services and data processing.
- Collaborate with product owners, architects, and stakeholders to define technical roadmaps.
- Ensure adherence to coding standards, best practices, and performance optimization.
- Conduct code reviews, mentor junior engineers, and foster a culture of continuous learning.
- Drive automation, CI/CD integration, and deployment strategies.
- Troubleshoot complex issues in distributed systems and ensure high availability.




- Align development efforts with business goals and timelines in an onsite leadership capacity.

Required Skills & Experience:

- Strong programming expertise in Java and Scala.
- Hands-on experience with Apache Spark (batch processing, distributed computing).
- Deep knowledge of ETL batch frameworks (e.g., Informatica, Talend, Spark ETL, custom frameworks).
- Experience with data warehousing concepts and large-scale data pipelines.
- Familiarity with cloud platforms (AWS, Azure, GCP) and big data ecosystems (HDFS, Hive, Kafka).
- Solid leadership and communication skills to manage onsite teams and coordinate with offshore PODs.
- Proven track record of delivering complex projects in Agile/Scrum environments.

Preferred Qualifications:

- Exposure to streaming frameworks (Spark Streaming, Flink, Kafka Streams).
- Experience with containerization and orchestration (Docker, Kubernetes).
- Knowledge of DevOps practices and CI/CD tools (Jenkins, GitLab CI, Azure DevOps).
- Prior experience as a technical lead or architect in data-intensive projects.

📌 Big Data Developer (Toronto)
🏢 Nityo Infotech
📍 Toronto