Take the stage as a Senior Databricks Architect and drive the optimization of ETL pipelines on cloud platforms. Your robust experience in Databricks, Spark, SQL, and real-time data processing will be essential.This role is designed for leaders in data engineering who excel in building productive ETL pipelines. Utilize your skills with Python and PySpark while integrating APIs and supporting real-time streaming solutions. Collaborate with cross-functional teams to manage projects and improve data workflows using Azure DevOps and Airflow.Key Responsibilities:
Build and manage ETL pipelines with Databricks
Develop data processing strategies using SQL and Python
Implement CI/CD processes via Azure DevOps
Utilize Airflow for effective workflow management
Support real-time data integration and streaming solutionsRequirements:
Extensive experience with Databricks and Spark
Solid capabilities in SQL and Python for ETL development
Experience with AWS or Azure platforms is essential
Familiarity with Delta Lake for data processing needed
Proven track record in leading data engineering initiativesDrive innovation in data processing and engineering with your deep expertise in cloud technologies.#J-18808-Ljbffr

📌 Senior Databricks Architect Specializing In Cloud Data Solutions Winnipeg
🏢 Acunor
📍 Winnipeg