Drive data innovations as a Senior Data Engineer working with Azure Databricks and the modern Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential. This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices.
Experience with GCP BigQuery migration is critical for this position. Key Responsibilities:
- Create and manage ETL/ELT data workflows
- Leverage Unity Catalog for data organization
- Tune SQL queries for optimal performance
- Oversee data migration and reconciliation processes
- Collaborate using Git and CI/CD methodologies Requirements:
- Proven experience with Azure Databricks
- Proficient in PySpark and Spark SQL
- Familiarity with Azure Data Lake Storage (ADLS)
- Expertise in GCP BigQuery migrations
- Robust SQL optimization skills Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape.
📌 Senior Data Engineer in Azure Environment (Toronto)
🏢 Viva Tech Solutions
📍 Toronto
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.