Lead Azure Databricks data engineering at Gore Mutual, designing scalable lakehouse infrastructure and production pipelines. Collaborate across teams to deliver trusted enterprise data.

This lead data engineering role supports the Databricks lakehouse, the enterprise single source of truth. You will guide data infrastructure development across policy, billing, claims, and finance data. The work includes data modeling, Azure services, Python, Spark, SQL, and production operations. You will collaborate with data scientists, product owners, IT, and business stakeholders.

Key Responsibilities:

- Design scalable, reliable, and resilient lakehouse infrastructure
- Build configuration-driven pipelines across business data domains
- Implement data quality checks within production pipelines




- Optimize pipeline performance, flow, and resource usage
- Provide technical leadership and mentor other engineers

Requirements:

- Five to eight years of relevant data engineering experience
- Bachelor’s or master’s degree in a related field
- Hands-on Azure Databricks and Microsoft Azure knowledge
- Proficiency in Python, Spark concepts, distributed systems, and SQL
- Experience with CI/CD, TDD, observability, and incident response

Apply your Azure Databricks, Python, Spark, and SQL expertise to lead reliable data platform delivery at Gore Mutual.

📌 Lead Azure Databricks Data Engineer (Cambridge)
🏢 goremutualinsurance
📍 Cambridge