20 Nov
|
LanceSoft
|
Montreal
20 Nov
LanceSoft
Montreal
- Strong programming experience in Python 3.x, including OOP, data structures, exception handling, and reusable modules.
- Hands-on experience with PySpark, Apache Spark, Spark SQL, and Spark DataFrames.
- Robust expertise in SQL, query optimization, and relational databases.
- Experience developing ETL/ELT pipelines and large-scale data transformation workflows.
- Knowledge of distributed computing, parallel processing, and big data architecture.
- Experience with data formats such as Parquet, Avro, JSON, CSV, and ORC.
- Experience with databases such as PostgreSQL, SQL Server, Oracle, MySQL, or similar.
- Hands-on experience with cloud platforms (AWS/Azure/GCP).
- Knowledge of Git, Jenkins, Azure DevOps, GitHub Actions, or other CI/CD tools.
Preferred / Nice-to-Have Skills
- Experience with Databricks, Delta Lake, and Lakehouse architecture.
- Knowledge of Snowflake, Amazon Redshift, Azure Synapse Analytics, or BigQuery.
- Experience with Apache Kafka and real-time streaming.
- Knowledge of Apache Airflow, AWS Glue, Azure Data Factory, or similar orchestration tools.
- Experience with Docker and Kubernetes.
- Understanding of data modeling, dimensional modeling, and data warehousing concepts.
- Experience with Terraform and cloud infrastructure automation.
📌 Python Pyspark Developer (Montreal)
🏢 LanceSoft
📍 Montreal