09 Aug
|
apptoza
|
Toronto
Data Engineer - ADF, ADB, PySpark, SQL, Azure Data Lake Gen2
Toronto ON – 4Days Onsite
Long Term Contract
Essential Skills:
- Azure Data Factory (ADF)
- Azure Databricks (ADB)
- PySpark
- SQL
- Architecting ETL Frameworks
Required Skills:
- Strong communication skills with the ability to liaise and coordinate with SMEs and technical partners
- Strong ability to break down technical requirements into actionable tasks
- Proficient with relational databases such as MS SQL and SQL scripting
- Proficient in building and maintaining Azure Data Factory pipelines for data ingestion orchestration
- Good OOP understanding with experience in Python or Java
- Proficiency with Git (Bitbucket or GitHub)
- Positive understanding of CI/CD concepts for building and deploying artifacts
- Understanding of synchronous and asynchronous data encryption/decryption
Nice to Have Skills:
- Azure Databricks Notebooks or Apache Spark for data transformations
- Datadog dashboard and monitoring experience Azure Data Lake Gen2
- Understanding of Parquet and Delta Lake concepts
- Experience with XLR for CI/CD Experience with Flyway for data migrations
Pay: $50.00-$55.00 per hour
Work Location: Hybrid remote in Toronto, ON (York District)
📌 Data Engineer - ADF, ADB, PySpark, SQL, Azure Data Lake Gen2 (Toronto)
🏢 apptoza
📍 Toronto