22 Nov
|
VySystems
|
Canada
Build scalable data pipelines with Python and PySpark as a Data Engineer focused on Azure Databricks and real-time streaming solutions.
This Data Engineer role requires 5-8 years of hands-on software development experience. You will use Spark SQL, DataFrames, Datasets, Delta tables, and Azure cloud services. The work includes translating business requirements into technical solutions through Agile Scrum practices.
Key Responsibilities:
- Build and optimize scalable data pipelines with PySpark
- Design real-time streaming solutions using Spark technologies
- Develop Azure Databricks workflows and Python scripts
- Write complex SQL queries and multi-table views
- Review code and coordinate across teams
Requirements:
- 5-8 years of hands-on software development experience
- Solid Python programming and PySpark expertise
- Experience with Azure Databricks and Delta tables
- Familiarity with Azure Data Lake and Data Factory
- Experience with Agile Scrum, GitHub, Jira, and Confluence
Apply your Python, PySpark, streaming, and Azure Databricks expertise to deliver reliable technical data solutions.
#J-18808-Ljbffr
📌 Senior Python PySpark Data Engineer (Canada)
🏢 VySystems
📍 Canada