We are seeking an experienced Python Developer – Data Engineering to join our data engineering team. The successful candidate will design, develop, and maintain high-performance data processing pipelines using modern Python frameworks and technologies.
The role involves working with large-scale datasets, containerized applications, distributed computing platforms, analytical databases, and event-driven architectures.
Key Responsibilities
- Develop and optimize data processing workflows using Python.
- Work with Pandas and Polars to manipulate, transform, and analyze large datasets.
- Design and implement containerized applications using Docker and Kubernetes.
- Build and maintain data pipelines integrating with ClickHouse and similar analytical databases.
- Develop event-driven architectures using NATS messaging systems.
- Write comprehensive unit and integration tests using Pytest.
- Implement distributed computing solutions using Dask.
- Optimize data processing workflows for performance and scalability.
- Maintain source code using Git and follow collaborative development practices.
- Participate in code reviews and contribute to engineering best practices.
Required Skills & Experience
- Advanced proficiency in Python.
- Strong hands-on experience with Pandas and Polars.
- Experience optimizing Python applications for large-scale data processing.
- Hands-on experience with Docker.
- Working knowledge of Kubernetes.
- Experience with ClickHouse or similar columnar/OLAP databases.
- Familiarity with NATS.io or similar messaging and streaming technologies.
- Strong experience with Pytest.
- Experience with Dask for distributed and out-of-core computing.
- Robust knowledge of Git, branching strategies, and collaborative development workflows.
Preferred Qualifications
- Experience with additional Python libraries used in data science and machine learning.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience working with large-scale data platforms.
- Financial services or capital markets data experience.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
Pay: $40.00-$45.00 per hour Work Location: Hybrid remote in Toronto, ON (Toronto District)
📌 Python Developer (Toronto)
🏢 CodeHire Global Solutions
📍 Toronto
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.