18 Sep
|
Synthires
|
Canada
Research Engineer - Code Generation & Model Evaluation
Position: Research Engineer - Code Generation & Model Evaluation
Type: Contractor
Compensation: $50–$100/hour
Location: Remote
About the Opportunity micro1 is engaging experienced Research Engineers to contribute to a customer project focused on code generation, software engineering, and AI model evaluation.
In this role, you will apply your software engineering and competitive programming expertise to help train and evaluate next-generation AI systems. Your work will involve solving complex programming problems, improving codebases, developing evaluation tasks, and providing structured feedback that helps AI models produce more accurate, reliable, and maintainable code.
Prior AI experience is not required—your technical expertise and software engineering experience are the primary focus.
Responsibilities
- Analyze, debug, and resolve issues across diverse codebases written in Python3, Java, Rust, C++, Go, and TypeScript.
- Design and implement new features and enhancements for code generation workflows.
- Refactor and optimize existing code to improve performance, maintainability, scalability, and adaptability.
- Develop realistic coding tasks and challenges designed to evaluate AI model performance and accuracy.
- Review AI-generated and human-written solutions for correctness, completeness, efficiency, and code quality.
- Author clear, actionable feedback and annotations to support AI model training and evaluation.
- Analyze complex programming constraints and evaluate multiple possible solution approaches.
- Collaborate with open-source contributors, engineers,
and technical stakeholders to improve technical direction and output quality.
- Document technical decisions, coding practices, solutions, and evaluation findings.
- Identify edge cases, inconsistencies, and potential failure modes in code and model-generated solutions.
Required Qualifications
- Strong expertise in competitive programming and coding problem analysis.
- Expertise in at least one of Python3, Java, Rust, C++, Go, or TypeScript.
- Strong understanding of algorithms and data structures.
- Proven track record of open-source contributions or participation in collaborative software projects.
- Strong analytical and problem-solving abilities for complex programming problems and multiple solution paths.
- Ability to evaluate code for correctness, performance, reliability, and output consistency.
- Excellent written and verbal communication skills with the ability to explain technical concepts clearly.
- Exceptional attention to detail in code validation and technical analysis.
- Ability to work independently in a remote, cooperative environment.
- Commitment to producing high-quality, maintainable, and well-documented code under deadlines.
Preferred Qualifications
- Experience contributing to established open-source projects.
- Experience with competitive programming platforms, algorithmic challenges, or technical problem setting.
- Strong proficiency across multiple programming languages.
- Experience with codebase refactoring, performance optimization, and debugging complex systems.
- Experience reviewing or evaluating programming solutions.
- Familiarity with AI coding systems, code-generation tools, model evaluation, or human-feedback workflows.
- Experience creating technical benchmarks, test cases, or structured evaluation criteria.
Key Areas of Expertise
- Code Generation
- Software Engineering
- Competitive Programming
- Algorithms & Data Structures
- Python3
- Java
- Rust
- C++
- Go
- TypeScript
- Debugging
- Feature Implementation
- Codebase Refactoring
- Performance Optimization
- Code Evaluation
- AI Model Evaluation
- Open-Source Development
- Technical Documentation
Compensation & Engagement
- Compensation: $50–$100/hour.
- Compensation is output-based, with experts paid per task that meets project specifications.
- Task completion time may vary depending on complexity, experience, and workflow.
- Minimum submission requirements apply.
- Experts are expected to complete a minimum number of tasks per week.
- Fully remote contractor engagement.
Application Process
1. Submit an updated resume highlighting your software engineering, competitive programming, and open-source experience.
2. Complete the initial application and screening process.
3. Participate in a technical or AI-based interview focused on coding, algorithms, and problem-solving expertise.
4. Complete a technical assessment or sample programming task if required.
5. Selected professionals proceed through onboarding and project assignment.
📌 Research Engineer – (Remote | ) (Canada)
🏢 Synthires
📍 Canada