Transform data practices as a Databricks Data Engineer, focusing on scalable ETL/ELT development in Azure environments. Leverage your technical acumen in PySpark to improve data migration and processing efficiency.

This position calls for a passionate data engineer with 7-10 years of experience, specializing in Azure Databricks and data architecture principles. You will implement data quality frameworks and optimize processing pipelines, ensuring adherence to Delta Lake best practices. Collaborate with cross-functional teams to drive performance tuning and historical data migration.

Key Responsibilities:
• Design and implement ETL/ELT pipelines in Azure Databricks
• Migrate BigQuery datasets to Delta Lake formats
• Build optimized batch and incremental data processing




• Develop reconciliation and validation frameworks
• Support historical data migration and production deployment

Requirements:
• Bachelor’s degree in IT or computer science
• Minimum 7-10 years in cloud-based data engineering
• Expert in Azure Databricks and Data Lakehouse Architecture
• Proficient in PySpark and Spark SQL
• Experience in data migration and frameworks

Utilize your expertise in Azure Databricks to drive data engineering excellence and support creative data solutions.
#J-18808-Ljbffr

📌 Databricks Data Engineer Role (Ontario)
🏢 TechDoQuest
📍 Ontario