06 Sep
|
Jobtailor
|
Toronto
- Build and evolve the Databricks-based data platform used for product features, machine learning, and internal reporting - Design and develop reliable and scalable data ingestion and transformation pipelines - Model raw data into clean, reliable datasets powering product features and internal analytics - Build platform abstractions and tooling improving developer experience for data producers and consumers - Improve observability, testing, and monitoring for reliability and performance - Manage and contribute to data governance, security, compliance, and access controls - Contribute to platform standards and architecture as the data platform scales - Collaborate with software development, machine learning, product, and analytics teams to support data use casesRequirements6+ years of experience as a data developer in a modern, production-grade cloud data platform (Databricks or similar equivalent)Experience operating under ambiguity and making technical tradeoffs that balance velocity and value delivery with maintainability and technical debtStrong Python and SQL skillsExperience with CDC pipelinesExperience managing cloud infrastructure with Terraform (or similar infrastructure-management equivalent)Experience building CI/CD workflows using DABs and GitHub Actions (or similar)Experience in query optimization, resource allocation and management, cost management, and data lake performanceExperience working in a fast-paced, agile environmentExpert level of English,
both spoken and written, requiredKnowledge of compliance and regulatory frameworks (e.G., GDPR, CCPA, SOC2, FedRAMP) considered for extra considerationExperience with event-streaming with Kafka and Flink (or similar data-streaming architectures) considered for extra considerationBackend software development experience, including application data storage and event-driven architecture considered for extra considerationExperience building and operating vector databases and RAG considered for extra considerationCore CompetenciesDemonstrates expertise in building and evolving Databricks-based data platforms, focusing on data ingestion, transformation, and governance. Proficient in Python, SQL, and managing cloud infrastructure, with a solid emphasis on compliance and performance optimization.Highest-signal resume keywordsDatabricks Data Platform DevelopmentPython ProgrammingSQL ProficiencyCloud Infrastructure ManagementCI/CD Workflow DevelopmentATS Optimization KeywordsHard SkillsData Ingestion PipelinesData TransformationQuery OptimizationEvent-Streaming with KafkaCDC PipelinesData Lake PerformanceVector DatabasesEvent-Driven ArchitectureTerraformGitHub ActionsSoft SkillsCollaborationProblem-SolvingAdaptabilityIndustry KeywordsData GovernanceComplianceGDPRCCPASOC2FedRAMPAgile EnvironmentTools & TechnologiesDatabricksTerraformGitHub ActionsKafkaFlink#J-18808-Ljbffr
📌 Senior Data Developer (Toronto)
🏢 Jobtailor
📍 Toronto