Lead Databricks data engineering at BDO with Azure and Apache Spark expertise in a blended office, client-site, and virtual model.
BDO Digital seeks an experienced Senior Data Engineer for its Technology Advisory Services practice. You will build production-grade pipelines with Databricks, Delta Lake, Azure Data Lake, and Apache Spark. The work combines hands-on engineering, technical leadership, and client engagement delivery.
Key Responsibilities: Design and optimize Databricks, Delta Lake, and Apache Spark pipelines
Develop reliable ETL for structured and unstructured data
Integrate cloud and on-premises data sources
Automate ingestion, transformation, and validation workflows
Lead client data engineering and analytics engagements
Requirements: Bachelor’s or master’s degree in a related discipline
At least five years of data engineering experience
At least three years using Databricks, Spark, and cloud platforms
Advanced Python and/or Scala programming skills
Azure ecosystem, CI/CD, and infrastructure-as-code experience
Apply Databricks, Azure, Spark, and technical leadership skills to deliver scalable data solutions for BDO clients.