AI Output Evaluation Specialist Needed
Only freelancers located in the U.S. may apply.U.S. located freelancers only
We are seeking a detail-oriented professional to review and evaluate AI-generated outputs based on strict evaluation criteria. The role requires exceptional attention to detail and availability to conduct 15+ hours of evaluation per week on an ongoing basis. DESCRIPTION OF ACTIVITY This job involves evaluating a high volume of AI-generated natural language outputs. Outputs you will review include text passages, chat exchanges, statements of fact, and recommendations. Your job will be to identify specific types of issues in these outputs based on defined criteria, and then label and describe each issue. You will work inside a proprietary evaluation platform that displays the data for your review and includes fields for you to input evaluation. NOTE ON AI USE You may not use AI to assist you in completing this work in any way, as this violates both our security policy and the core methodology of this work. SERVICE LEVEL AGREEMENT To maintain the rapid feedback loop necessary for this work, we adhere to a 48-hour turnaround time (SLA) for all evaluations. While you have flexibility in choosing when you work your 15+ hours per week, this is not a role where hours can be batched into a single day. Reviewers are expected to log into the task queue at least 2-3 times per work week (ie. roughly every other day) to clear pending tasks. REQUIREMENTS Candidates must: - be located in the US - have strong ability to read and analyze content written in English - bring exceptional attention to detail - adhere to strict evaluation criteria involving analysis of natural language - pass background check and adhere to very strict security/confidentiality requirements All candidates must have at least one prior job in AI evaluation. Please make sure to describe related prior work in your cover letter.
- Less than 30 hrs/weekHourly
- 3-6 monthsDuration
- IntermediateExperience Level
$15.00
-
$30.00
Hourly- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesOakland2:21 PM
- $132K total spent24 hires, 14 active
- 4,106 hours
- Large company (100-1,000 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by