Build pretraining data systems at Cohere using Python, data pipelines, and machine learning expertise. This role is remote-friendly between EST and EU.

As a Machine Learning Engineer specializing in pretraining data, you will develop pipelines supporting Cohere’s advanced language models. You will combine research and engineering across data ablations, data mixtures, and curation methods. Your work will improve training throughput and accelerator utilization.

Key Responsibilities:

- Conduct data ablations to assess quality and test data mixtures
- Develop data modeling techniques for effective training datasets
- Research and implement innovative data curation methods
- Use Cohere infrastructure to advance natural language processing




- Collaborate with researchers and engineers on data pipelines

Requirements:

- Strong software engineering skills with Python proficiency
- Experience building data pipelines and processing large datasets
- Familiarity with curriculum learning, data mixing, and attribution
- Experience with Spark, Beam, Pandas, or similar frameworks
- Experience with web, code, and multilingual datasets

Apply your Python, data curation, and machine learning engineering skills to strengthen Cohere’s language model training systems.

📌 Machine Learning Engineer Pretraining Data (Toronto)
🏢 Avenue.io
📍 Toronto