Join Toptal as a Senior Data/ML Engineer, enhancing a vital forecasting platform remotely. Bring your expertise in Databricks, Python, and PySpark to modernize existing systems.
This senior role focuses on refactoring an existing time series forecasting system that has been maintained for years. You will streamline workflows, improve observability, and bring discipline to an established codebase, contributing significantly to software quality. Your experience will help the platform grow and adapt to evolving business needs.
Key Responsibilities:
• Review and assess forecasting platform for improvements
• Refactor existing Python and Databricks components
• Modularize business logic from notebooks into Python
• Strengthen testing practices and monitoring capabilities
• Enhance reliability and efficiency of training workflows
Requirements:
• In-depth experience with Databricks and CI/CD pipelines
• Robust Python skills for development of reusable components
• Expertise in PySpark for high-performance data processing
• Background in refactoring production systems for sustainability
• Familiarity with time series forecasting and model observability
Make a meaningful impact at Toptal, ensuring continuity and improvement for a critical forecasting engine!
#J-18808-Ljbffr