23 Oct
|
Apptad
|
Quebec City
23 Oct
Apptad
Quebec City
Job Title: Data Engineer - (Pyspark & Python) Job Location: Montreal, QC (Hybrid) Job Overview: We are seeking a skilled Senior Data Engineer with 5 to 7 years of experience specializing in Python and PySpark.
In this role, you will design, build, and optimize robust data pipelines while serving as a primary technical point of contact for clients.
The ideal candidate bridges the gap between complex data engineering and strategic client communication.
Key Responsibilities Data Pipeline Development: Design, develop, and maintain scalable data processing pipelines using Python and PySpark.
Client Engagement: Act as the technical face of the team, gathering requirements, presenting data solutions, and managing stakeholder expectations.
Optimization & Performance: Tune Spark jobs for optimal performance, troubleshooting bottlenecks in large-scale data environments.
Collaboration: Partner with cross-functional teams, including data scientists, analysts, and project managers,
to deliver business-critical data products.
Required Skills & Qualifications Experience: 5 7 years of professional experience in data engineering.
Core Technical Skills: Strong proficiency in Python and hands-on expertise with PySpark (Spark SQL, Data
Frames, RDDs).
Client-Facing Skills: Proven experience in client-facing roles, with excellent verbal and written communication skills to articulate technical concepts to non-technical stakeholders.
Data Ecosystems: Solid understanding of SQL, data warehousing concepts, and cloud data platforms (AWS, Azure, or GCP).
Software Practices: Familiarity with Git, CI/CD pipelines, and writing clean, maintainable code.
Preferred Qualifications Experience working in an Agile/Scrum setting.
Knowledge of orchestration tools like Apache Airflow.
📌 Data Engineer (Pyspark, Python) (Quebec City)
🏢 Apptad
📍 Quebec City