via Remote Rocketship
$42K - 78K a year
Review AI-generated code responses for technical accuracy and best practices, providing expert feedback to improve AI coding outputs.
Bachelor's or higher in Computer Science, expert Python skills, strong analytical and writing abilities, experience with LLMs, and preferably RLHF annotation and software engineering experience.
Job Description: • This project involves reviewing AI-generated responses, evaluating technical accuracy and best practices, and providing expert feedback that trains AI systems to write better code. • You'll work with various programming languages and coding challenges, ensuring AI outputs are functional, efficient, and follow industry standards. Requirements: • BS, MS, or PhD with a significant focus on Computer Science (Required). • Expert in Python, with a firm grasp of algorithms, data structures, and debugging practices. • Expert-level English proficiency with excellent writing skills. • Expert at fact-checking information using public sources across multiple domains. • Significant experience using large language models (LLMs). • Strong analytical and structured thinking skills. • Ability to explain complex programming concepts clearly and accurately. • Prior experience with RLHF annotation (preferred). • Prior Software Engineering work experience (strongly preferred). • Expertise in additional programming languages (nice to have): C#, Java, SQL, C++, TypeScript, PHP, C, Go, Bash, PowerShell, Rust, R. Benefits: • Competitive and reliable weekly compensation
This job posting was last updated on 12/4/2025