We are looking for an experienced Big Data Lead to design, develop, and maintain scalable data solutions using PySpark, Spark SQL, Python, and distributed computing technologies.
Job Description: -
Required Skills & Experience
- 8+ years of experience in Big Data / Data Engineering.
- Strong hands-on experience with PySpark and Apache Spark.
- Strong programming skills in Python.
- Excellent knowledge of Spark SQL and distributed data processing.
- Experience designing and developing ETL/ELT data pipelines.
- Strong understanding of distributed computing and big data concepts.
- Experience working with Hadoop/HDFS, Hive, cloud storage, or data lake platforms.
- Robust understanding of Spark performance tuning,
including partitioning, caching, joins, shuffles, and resource optimization.
- Experience writing unit tests and data validation frameworks.
- Strong SQL skills and experience working with large datasets.
- Experience with data pipeline monitoring, troubleshooting, and production support.
EEOC Compliance:
We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER
AI Usage Policy: Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.
#J-18808-Ljbffr
📌 Big Data Lead (Mississauga)
🏢 Pacer Group
📍 Mississauga
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.