Job SummaryWe are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems.Key ResponsibilitiesDesign and implement scalable ETL pipelines using Databricks & SparkBuild Lakehouse architecture using Delta LakeDevelop and deploy ML models using MLflowImplement MLOps pipelines for training, testing, and serving modelsOptimize cluster performance and reduce compute costBuild RAG and LLM-based solutions using Mosaic AIIntegrate analytics with BI tools (Power BI, Tableau)Implement data governance using Unity CatalogCollaborate with Data Scientists and Business teamsEnsure data quality, security, and complianceRequired SkillsMandatory5+ years of Databricks & Apache SparkStrong Python & PySparkExperience with Delta Lake & LakehouseMLflow & MLOps experienceCloud platform (AWS/Azure/GCP)Git & CI/CDPreferredExperience with LLMs & Generative AIRAG pipelines & Vector DatabasesDeep Learning frameworksDatabricks certificationsPower BI integrationRequirementsJob SummaryWe are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end-to-end ownership of data pipelines, ML workflows, and production AI systems.Key ResponsibilitiesDesign and implement scalable ETL pipelines using Databricks & SparkBuild Lakehouse architecture using Delta LakeDevelop and deploy ML models using MLflowImplement MLOps pipelines for training, testing, and serving modelsOptimize cluster performance and reduce compute costBuild RAG and LLM-based solutions using Mosaic AIIntegrate analytics with BI tools (Power BI, Tableau)Implement data governance using Unity CatalogCollaborate with Data Scientists and Business teamsEnsure data quality, security, and complianceRequired SkillsMandatory5+ years of Databricks & Apache SparkStrong Python & PySparkExperience with Delta Lake & LakehouseMLflow & MLOps experienceCloud platform (AWS/Azure/GCP)Git & CI/CDPreferredExperience with LLMs & Generative AIRAG pipelines & Vector DatabasesDeep Learning frameworksDatabricks certificationsPower BI integration #J-18808-Ljbffr

📌 Sr Data Engineer - (Toronto)
🏢 iLink Digital
📍 Toronto