Build production-grade data pipelines with Databricks and Azure at BDO Digital, using a blended office, client-site, and virtual model. As a Senior Data Engineer in Technology Advisory Services, you will lead hands-on engineering and client engagements. Apply Databricks, Delta Lake, Apache Spark, and Azure Data Lake to create scalable data solutions. Translate business requirements into architectures, operational plans, and production-ready platforms. Key Responsibilities:
Design and optimize pipelines using Databricks, Delta Lake, and Apache Spark Develop ETL processes for structured and unstructured data Integrate cloud and on-premises sources through Azure Data Lake Lead client engagements and translate requirements into scalable architectures Monitor reliability,
security, compliance, and pipeline performance Requirements:
Bachelor’s or master’s degree in a related discipline At least five years of hands-on data engineering experience At least three years using Databricks, Spark, and cloud platforms Advanced Python and/or Scala programming skills Azure, CI/CD, infrastructure-as-code, and production experience Bring senior data engineering leadership, Databricks expertise, and Azure delivery skills to BDO Digital’s client-focused practice.