Drive data innovations as a Senior Data Engineer working with Azure Databricks and the contemporary Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential.

This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices. Experience with GCP BigQuery migration is critical for this position.

Key Responsibilities:
• Create and manage ETL/ELT data workflows
• Leverage Unity Catalog for data organization
• Tune SQL queries for optimal performance
• Oversee data migration and reconciliation processes
• Collaborate using Git and CI/CD methodologies

Requirements:
• Proven experience with Azure Databricks
• Proficient in PySpark and Spark SQL
• Familiarity with Azure Data Lake Storage (ADLS)
• Expertise in GCP BigQuery migrations
• Strong SQL optimization skills

Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape.
#J-18808-Ljbffr

📌 Senior Data Engineer in Azure Environment (Ontario)
🏢 Viva Tech Solutions
📍 Ontario