Drive data innovations as a Senior Data Engineer working with Azure Databricks and the contemporary Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential.

This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices. Experience with GCP BigQuery migration is critical for this position.

Key Responsibilities: • Create and manage ETL/ELT data workflows • Leverage Unity Catalog for data organization • Tune SQL queries for optimal performance • Oversee data migration and reconciliation processes • Collaborate using Git and CI/CD methodologies

Requirements: • Proven experience with Azure Databricks • Proficient in PySpark and Spark SQL • Familiarity with Azure Data Lake Storage (ADLS) • Expertise in GCP BigQuery migrations • Solid SQL optimization skills

Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape. #J-18808-Ljbffr

📌 Senior Data Engineer In Azure Environment Winnipeg
🏢 Viva Tech Solutions
📍 Winnipeg