Role: Apache Spark - Development Lead

Location: Toronto, Canada (4 days WFO)

Job Type: Fulltime

Role Overview:

We are looking for a seasoned Development Lead to guide and mentor a high-performing engineering team. The ideal candidate will have solid hands-on expertise in Java, Scala, Apache Spark, and ETL batch frameworks, with proven leadership skills to drive end-to-end delivery of scalable data solutions.

Key Responsibilities:
Lead a team of developers and data engineers in designing and implementing enterprise-grade solutions.
Architect and oversee development of ETL batch pipelines using Spark and related frameworks.
Provide technical leadership in Java/Scala programming for backend services and data processing.
Collaborate with product owners, architects, and stakeholders to define technical roadmaps.
Ensure adherence to coding standards, best practices, and performance optimization.
Conduct code reviews, mentor junior engineers, and foster a culture of continuous learning.
Drive automation, CI/CD integration, and deployment strategies.
Troubleshoot complex issues in distributed systems and ensure high availability.




Align development efforts with business goals and timelines in an onsite leadership capacity.

Required Skills & Experience:
Strong programming expertise in Java and Scala.
Hands-on experience with Apache Spark (batch processing, distributed computing).
Deep knowledge of ETL batch frameworks (e.g., Informatica, Talend, Spark ETL, custom frameworks).
Experience with data warehousing concepts and large-scale data pipelines.
Familiarity with cloud platforms (AWS, Azure, GCP) and big data ecosystems (HDFS, Hive, Kafka).
Solid leadership and communication skills to manage onsite teams and coordinate with offshore PODs.
Proven track record of delivering complex projects in Agile/Scrum settings.

Preferred Qualifications:
Exposure to streaming frameworks (Spark Streaming, Flink, Kafka Streams).
Experience with containerization and orchestration (Docker, Kubernetes).
Knowledge of DevOps practices and CI/CD tools (Jenkins, GitLab CI, Azure DevOps).
Prior experience as a technical lead or architect in data-intensive projects.

📌 Big Data Developer Toronto
🏢 Nityo Infotech
📍 Toronto