Lead Databricks and Azure data engineering at BDO Digital, building scalable pipelines and guiding client engagements within Technology Advisory Services.
As a Senior Data Engineer, you will combine technical leadership with hands-on delivery for production-grade data solutions. Your work spans Databricks, Delta Lake, Apache Spark, Azure Data Lake, and scalable ETL. You will align data initiatives with business objectives while supporting analytics and machine learning initiatives.
Key Responsibilities: Design and optimize pipelines using Databricks, Delta Lake, and Apache Spark
Develop ETL processes for structured and unstructured data
Integrate cloud and on-premises sources through Azure Data Lake
Lead client engagements and translate requirements into architectures
Mentor team members and document data pipelines
Requirements: Five years of hands-on data engineering experience
Three years using Databricks, Apache Spark, and cloud platforms
Robust Microsoft Azure ecosystem knowledge
Advanced Python and/or Scala programming skills
Experience with CI/CD and infrastructure-as-code tools
Bring Databricks, Azure, Spark, and client leadership expertise to BDO Digital’s production-grade data engineering engagements.