AI Output Evaluation Specialist Needed

Posted 4 weeks ago

Only freelancers located in the U.S. may apply.U.S. located freelancers only

Needs to hire 2 Freelancers
Summary

We are seeking a detail-oriented professional to review and evaluate AI-generated outputs based on strict evaluation criteria. The role requires exceptional attention to detail and availability to conduct 15+ hours of evaluation per week on an ongoing basis. DESCRIPTION OF ACTIVITY This job involves evaluating a high volume of AI-generated natural language outputs. Outputs you will review include text passages, chat exchanges, statements of fact, and recommendations. Your job will be to identify specific types of issues in these outputs based on defined criteria, and then label and describe each issue. You will work inside a proprietary evaluation platform that displays the data for your review and includes fields for you to input evaluation. NOTE ON AI USE You may not use AI to assist you in completing this work in any way, as this violates both our security policy and the core methodology of this work. SERVICE LEVEL AGREEMENT To maintain the rapid feedback loop necessary for this work, we adhere to a 48-hour turnaround time (SLA) for all evaluations. While you have flexibility in choosing when you work your 15+ hours per week, this is not a role where hours can be batched into a single day. Reviewers are expected to log into the task queue at least 2-3 times per work week (ie. roughly every other day) to clear pending tasks. REQUIREMENTS Candidates must: - be located in the US - have strong ability to read and analyze content written in English - bring exceptional attention to detail - adhere to strict evaluation criteria involving analysis of natural language - pass background check and adhere to very strict security/confidentiality requirements All candidates must have at least one prior job in AI evaluation. Please make sure to describe related prior work in your cover letter.

  • Less than 30 hrs/week
    Hourly
  • 3-6 months
    Duration
  • Intermediate
    Experience Level
  • $15.00

    -

    $30.00

    Hourly
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Google Sheets
English
Activity on this job
  • Proposals:50+
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Oct 15, 2020
  • United States
    Oakland2:21 PM
  • $132K total spent
    24 hires, 14 active
  • 4,106 hours
  • Large company (100-1,000 people)

Explore similar jobs on Upwork

Academic Writing
Content Writing
Writing
Data Entry
Academic Research
Research Methods
Usability Testing
UX Research
Mobile App Testing

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo