Title: Senior Data Engineer – Azure Databricks / AI & ML Workplace Type: Remote

Working Hours
PST Duration: Long-Term Contract Team: AI Center of Excellence (AI COE) Job Summary We are looking for a Senior Data Engineer to join our AI Center of Excellence (AI COE) team. The ideal candidate will have strong hands-on expertise in Azure Databricks, Medallion Architecture, and AI/ML technologies. This role requires a senior, technically proficient professional who can design, develop, and optimize scalable data engineering solutions supporting AI and machine learning initiatives.

Key Responsibilities
- Design and develop scalable data pipelines using Azure Databricks and Apache Spark.
- Implement and maintain Medallion Architecture (Bronze, Silver, and Gold layers).
- Build and optimize ETL/ELT pipelines for structured and unstructured data.
- Prepare and transform data for AI/ML model development and deployment.
- Collaborate with data scientists, ML engineers, and AI teams to support AI-driven solutions.
- Optimize data processing, performance, reliability, and cost efficiency.
- Implement data quality, validation, governance, and security best practices.
- Work with Delta Lake and related Databricks capabilities to manage enterprise data platforms.




- Provide hands-on technical leadership and contribute to data architecture and engineering best practices. Required Skills
- Strong hands-on experience with Azure Databricks and Apache Spark.
- Proven experience implementing Medallion Architecture .
- Strong knowledge of Python, PySpark, SQL, and data engineering principles.
- Experience building and optimizing ETL/ELT pipelines and working with Delta Lake.
- Understanding of AI/ML concepts and data preparation for machine learning workflows.
- Experience working with large-scale data processing and cloud-based data platforms.
- Solid troubleshooting, problem-solving, and performance optimization skills. Preferred Qualifications
- Experience supporting AI/ML or Generative AI initiatives.
- Familiarity with MLflow and machine learning lifecycle management.
- Knowledge of Azure data services and data governance practices.
- Strong communication and collaboration skills. Ideal Candidate: A senior, fully hands-on Data Engineer with deep Azure Databricks and Medallion Architecture expertise who can contribute immediately to AI/ML initiatives within the AI COE team.

📌 Data Engineer (Canada)
🏢 Cloud Data Vision
📍 Canada