Drive data innovations as a Senior Data Engineer working with Azure Databricks and the contemporary Data Lakehouse architecture. Your skills in PySpark and Spark SQL will be essential.
This role involves in-depth experience with Azure Databricks, focusing on ETL/ELT Development and SQL performance tuning. You will also utilize Azure Data Lake Storage (ADLS) and implement CI/CD best practices. Experience with GCP BigQuery migration is critical for this position.
Key Responsibilities: • Create and manage ETL/ELT data workflows • Leverage Unity Catalog for data organization • Tune SQL queries for optimal performance • Oversee data migration and reconciliation processes • Collaborate using Git and CI/CD methodologies
Requirements: • Proven experience with Azure Databricks • Proficient in PySpark and Spark SQL • Familiarity with Azure Data Lake Storage (ADLS) • Expertise in GCP BigQuery migrations • Strong SQL optimization skills
Apply your advanced engineering knowledge to innovate data solutions in the Azure landscape. #J-18808-Ljbffr
📌 Senior Data Engineer in Azure Environment (Winnipeg)
🏢 Viva Tech Solutions
📍 Winnipeg
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.