Drive data innovations as a Senior Data Engineer working with Azure Databricks and the up-to-date Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential. This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices.

Experience with GCP BigQuery migration is critical for this position. Key Responsibilities:
Create and manage ETL/ELT data workflows
Leverage Unity Catalog for data organization
Tune SQL queries for optimal performance
Oversee data migration and reconciliation processes
Collaborate using Git and CI/CD methodologies Requirements:
Proven experience with Azure Databricks
Proficient in PySpark and Spark SQL
Familiarity with Azure Data Lake Storage (ADLS)
Expertise in GCP BigQuery migrations
Robust SQL optimization skills Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape.

📌 Senior Data Engineer In Azure Environment Toronto
🏢 Viva Tech Solutions
📍 Toronto