Drive data innovations as a Senior Data Engineer working with Azure Databricks and the contemporary Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential.
This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices. Experience with GCP BigQuery migration is critical for this position.
Key Responsibilities:
• Create and manage ETL/ELT data workflows
• Leverage Unity Catalog for data organization
• Tune SQL queries for optimal performance
• Oversee data migration and reconciliation processes
• Collaborate using Git and CI/CD methodologies
Requirements:
• Proven experience with Azure Databricks
• Proficient in PySpark and Spark SQL
• Familiarity with Azure Data Lake Storage (ADLS)
• Expertise in GCP BigQuery migrations
• Robust SQL optimization skills
Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape.
J-18808-Ljbffr

📌 Senior Data Engineer In Azure Environment Toronto
🏢 Viva Tech Solutions
📍 Toronto