via Remote Rocketship
$85K - 150K a year
Evaluate AI-generated code interactions for quality and provide clear, opinionated feedback to define high standards.
Senior-level engineer with strong TypeScript/JavaScript skills, experience with AI coding tools like Claude Code, and ability to assess code quality without deep execution.
Job Description: • Evaluate AI-generated coding interactions end-to-end • Judge whether outputs are useful and correct at a high level • Assess the quality of explanations and reasoning • Distinguish between different levels of response quality • Provide clear, opinionated feedback on interactions • Help define what great looks like when interacting with tools Requirements: • Staff / Principal-level engineer (or equivalent experience) • Strong background in TypeScript / JavaScript or Python • Hands-on experience using OpenAI Codex, Claude Code, and Cursor • Deep familiarity with modern AI-assisted dev workflows • Able to evaluate code without needing to fully execute or deeply review every line • Comfortable giving direct, opinionated feedback • High bar for what ‘good engineering’ looks like Benefits: • Competitive compensation based on experience • Project-based work with flexible hours • Potential to work on multiple projects
This job posting was last updated on 6/26/2026