via Remote Rocketship
$40K - 70K a year
Evaluate AI model outputs related to administrative and operational tasks, develop prompts, and provide structured feedback.
Requires at least 4 years of professional experience in administrative, operational, or related roles, with the ability to work asynchronously and develop prompts for AI models.
Job Description: • Handshake is recruiting Administrative Services Managers Professionals to contribute to an hourly, temporary AI research project—but there’s no AI experience needed. • In this program, you’ll leverage your professional experience to evaluate what AI models produce in your field, assess content related to your field of work, and deliver clear, structured feedback that strengthens the model’s understanding of your workplace tasks and language. • The position is remote and asynchronous; work independently from wherever you are. • The hours are flexible, with no minimum commitment, but most average 5-20 hrs • The work includes developing prompts for AI models that reflect your field, and then evaluating responses. • You’ll learn new skills and contribute to how AI is used in your field • Your placement into a project will be dependent on project availability—if you apply now and can’t work on this project, more will be available soon. Requirements: • You have at least 4 years of professional experience in one or more of the following types of work. • The examples below reflect the types of real-world responsibilities that you might have had in your role that will give you the context needed to evaluate and train high-quality AI models • Coordinate and oversee the administrative services department by setting goals, managing budgets, and ensuring efficient operations. • Develop and implement procedural changes, supervise staff, and liaise with external vendors to meet organizational needs. • Conduct training sessions and manage filing systems to maintain accurate records. • You’re able to participate in asynchronous work in partnership with leading AI labs. Benefits:
This job posting was last updated on 1/9/2026