AI Content Evaluator – AI Training & Evaluation

Job Description

Handshake AI Fellow | Handshake

The Tone:
This is a remote and asynchronous role at Handshake, available from anywhere on your own schedule. Handshake AI is a program focused on applying professional and academic expertise to improve artificial intelligence systems. This position plays a vital part in developing high-quality training content and evaluating AI-generated responses. The core purpose of this role is to help AI achieve a deeper understanding of real-world tasks and complex workflows.

The TL;DR
• Role: Early Career
• Location: Remote, Worldwide

• Mission: Helping AI better understand real-world tasks and workflows.

What You’ll Actually Do
• Content Creation: Create training content using your professional and academic expertise.
• Accuracy Evaluation: Evaluate AI-generated responses specifically for their accuracy.
• Quality Assessment: Assess the overall quality of AI-generated responses.
• Expertise Application: Apply your professional and academic knowledge to the tasks of content creation and AI response evaluation.
• Guideline Adherence: Work according to project-specific guidelines provided upon onboarding.

The Must-Haves
• Background: Candidates should possess professional and academic expertise. Prior experience with artificial intelligence is not required for this role.
• Experience: Not specified in years; the role values the application of existing professional and academic knowledge to new challenges.
• Skills: Content creation, AI response evaluation, critical assessment of information, understanding of real-world tasks and workflows.