About the Role
We are looking for Senior Software Engineers with solid experience in Python or TypeScript/JavaScript/Golang and hands-on exposure to preference data collection and/or rubric creation.
This role is ideal for engineers who combine strong software engineering fundamentals with excellent judgment, attention to quality, and the ability to turn complex technical work into clear, actionable outcomes.
You will work on cutting-edge AI/LLM projects, supporting data generation, collection, evaluation, and engineering workflows.
Key Responsibilities
Design, refine, and iterate on rubrics and evaluation criteria for preference data.
Review and label data while maintaining a high quality bar and identifying subtle issues.
Build and maintain pipelines and infrastructure supporting data generation, collection, and evaluation.
Analyze findings and communicate them through clear technical write-ups, updates, and recommendations.
Must-Have Technical Skills 5+ years of professional software engineering experience.
Strong proficiency in Python, particularly building and maintaining pipelines/infrastructureOR strong experience with TypeScript / JavaScript / Golang.
Hands-on experience with preference data collection and/or rubric creation.
Experience working with large and complex codebases is highly relevant. Experience with codebases such as VSCode is a plus.
Strong understanding of software engineering practices, debugging, code quality, and scalable development workflows.
Ability to evaluate technical/data quality and clearly explain why something is good or needs improvement. Preferred Candidate Profile Experience working in Tier-1 technology/product companies.
Graduate from a Tier-1 university.
Candidates currently working with Microsoft are not eligible. Availability Requirements Minimum 20 hours per week commitment.
Minimum 4 hours per day.
Must be able to provide at least 4 hours of overlap with PST