Take the lead in creating a scalable Databricks Lakehouse architecture on Azure. This hands-on role focuses on building PySpark pipelines while driving enterprise-wide data governance.
As a Databricks Architect, you will design and manage secure architecture aligned with enterprise standards. You will also focus on migrating legacy ETL workloads while optimizing performance and costs across the platform. Your role is key in enabling analytics and AI solutions by collaborating closely with business stakeholders.
Key Responsibilities:
• Architect scalable Databricks Lakehouse on Azure services
• Build and review PySpark and Spark SQL data pipelines
• Drive migration of complex legacy ETL workloads to Databricks
• Optimize cluster performance and establish FinOps practices
• Implement data governance through Unity Catalog and Purview
Requirements:
• 12+ years in data engineering or platform architecture
• 4+ years of hands-on experience with Databricks
• Proficient in Azure DevOps and CI/CD best practices
• Robust understanding of data governance and compliance
• Experience with BI tools like Power BI and ML technologies
Lead the evolution of your data architecture skills while optimizing and securing data operations.
#J-18808-Ljbffr