20 Sep
|
Confiar Services
|
Toronto
20 Sep
Confiar Services
Toronto
Job Title: Spark with Scala Developer (Java Background)
Location: Toronto, Canada
Duration: Long Term Contract
Job Summary
We are looking for an experienced Spark with Scala Developer with a robust Java background to design, develop, and optimize large-scale data processing applications. The ideal candidate will leverage their Java expertise and transition seamlessly into Scala-based Spark development, building high-performance, scalable, and reliable data solutions.
Key Responsibilities
Design and develop big data applications using Apache Spark and Scala.
Build and optimize ETL/data processing pipelines for large datasets.
Develop scalable, high-performance solutions on distributed data platforms.
Utilize Java expertise to enhance Spark applications and integrate existing Java libraries.
Troubleshoot performance issues and optimize Spark jobs.
Work closely with data engineers, architects, and business stakeholders.
Ensure code quality through testing, code reviews, and best practices.
Participate in system design, performance tuning, and production support.
Required Skills
5+ years of software development experience.
Strong hands-on experience with Java development.
Experience with Apache Spark and Scala.
Valuable understanding of distributed computing concepts.
Knowledge of JVM internals, memory management, and performance tuning.
Experience with SQL and large-scale data processing.
Familiarity with Hadoop ecosystem and cloud platforms is a plus.
Solid problem-solving and analytical skills.
Preferred Qualifications
Experience with Databricks, Kafka, or streaming technologies.
Exposure to AWS, Azure, or Google Cloud platforms.
Knowledge of CI/CD, Git, and Agile methodologies.
📌 Spark And Scala Developer Toronto
🏢 Confiar Services
📍 Toronto