Join Infosys as a Big Data Specialist focused on PySpark solutions in Mississauga, Ontario. Develop sophisticated data pipelines and enhance processing efficiency in a dynamic team setting.

We are seeking a talented PySpark Developer to create and optimize data processing solutions utilizing Apache Spark and the Hadoop ecosystem. Your role will involve close collaboration with various tech teams to ensure robust and scalable data systems. A strong grasp of distributed computing and proven big data experience are essential for success.

Key Responsibilities:



• Build large-scale data pipelines using Spark and PySpark • Optimize batch and real-time workflows with Kafka and Hadoop • Create Spark applications employing RDDs and DataFrames • Manage data lakes with HDFS, Hive, and NoSQL solutions • Integrate multiple data sources including streaming systems

Requirements: • At least 4 years of experience in IT and big data • Proven skills in Apache Spark, Scala, and PySpark • Experience with data pipelines and performance tuning • Solid understanding of distributed computing concepts • Excellent communication and stakeholder management skills

Leverage your expertise in big data to drive impactful solutions with Infosys. #J-18808-Ljbffr

📌 Big Data Specialist - PySpark Focus (Winnipeg)
🏢 Infosys
📍 Winnipeg