via LinkedIn
$25K - 31K a year
Evaluate and rank AI outputs by producing natural data and reviewing responses from large language models.
Strong writing, analytical and problem-solving skills, attention to detail, and ability to develop professional-level prompts for AI evaluation.
*Earn up to $15/hour + performance bonuses. Work remotely and flexibly.* Outlier, a platform owned and operated by Scale AI, is looking for* English speakers* to contribute their expertise toward training and refining cutting-edge AI systems. If you're passionate about improving models and excited by the future of AI, this is your opportunity to make a real impact. What You’ll Do • *Adopt a “user mindset” *to produce natural* *data to meet the realistic needs* *you have or would use AI for. • *Evaluate AI outputs* by reviewing and ranking responses from large language models. • *Contribute across projects* depending on your specific skillset and experience. What We’re Looking For • *Analytical and Problem-Solving Skills*: Ability to develop complex, professional-level prompts and evaluate nuanced AI reasoning. • *Strong Writing*: Clear, concise, and engaging writing to explain decisions or critique responses. • *Attention to Detail*: Commitment to accuracy and ability to assess technical aspects of model outputs. Nice to Have • Experience in fields like literature, creative writing, history, philosophy, theology, etc. • Prior writing or editorial experience (content strategist, technical writer, editor, etc.). • Interest or background in AI, machine learning, or creative tech tools. Pay & Logistics • *Base Rate*: Up to $15/hour USD, depending on experience. • *Bonuses*: Additional pay available based on project performance. • *Type*: Freelance/1099 contract — not an internship. • *Location*: 100% remote • *Schedule*: Flexible hours — you choose when and how much to work. • *Payouts*: Weekly via our secure platform. • This is a freelance position that is paid on a per-hour basis.* We don’t offer internships as this is a freelance role. You also must be authorized to work in your country of residence, and *we will not *be providing sponsorship since this is a 1099 contract opportunity. However, if you are an international student, you may be able to sign up if you are on a visa. You should contact your tax/immigration advisor with specific questions regarding your circumstances. We are unable to provide any documentation supporting employment at this time. Please be advised that compensation rates may differ for non-US locations.
This job posting was last updated on 12/10/2025