Take your career to the next level as a Senior PySpark Developer with Infosys in Mississauga, Ontario. Focus on designing and implementing high-performance data solutions for scalable architectures.
Infosys is on the lookout for a Senior PySpark Developer to work on cutting-edge data processing projects. This role will require you to leverage your extensive Spark and Scala knowledge while collaborating with engineers and business experts. You should have a solid track record in building effective data pipelines and a keen understanding of big data technologies.
Key Responsibilities:
• Develop and optimize large-scale data processing systems using Spark • Implement efficient batch and streaming workflows leveraging Kafka • Create Spark applications for complex transformations and data modeling • Maintain data lake solutions with the Hadoop ecosystem • Collaborate with teams to ensure scalable solutions meet business needs
Requirements: • 4+ years in IT with a focus on big data • Robust experience in Apache Spark, Scala, and PySpark • Familiarity with data lakes, data warehouses, and ETL design • Understanding of distributed systems and performance tuning • Ability to translate business needs into technical solutions
Create lasting impact through your skills in data processing at Infosys. #J-18808-Ljbffr