Research evaluator needed to score written answers for depth, specificity, and usefulness

We are looking for detail-oriented research evaluators to review written answers to provided questions. Your task will be to assess how useful each answer is based on how deep, specific, well-reasoned, and decision-relevant it is. You will not be judging whether you personally agree with the answer. You will evaluate whether the answer gives clear, concrete feedback that someone could actually use. This work is best suited for people with experience in research, academic writing, qualitative analysis, survey evaluation, UX research, market research, or similar analytical work. What you will do You will review answers and assign a quality score using a defined rubric. Each answer should be evaluated based on: - Relevance to the question - Specificity of the response - Depth of reasoning - Clarity of explanation - Whether the answer includes actionable insight - Whether the feedback is grounded in the provided stimulus or context - Whether the answer gives a decision-maker something useful to act on - Evaluation rubric Please use the following scoring levels: N/A - Cannot assess Use this when the answer is not a genuine or usable response. Examples: - Test or garbage input - Unintelligible answer - Broken or missing content - Not enough information to evaluate Important: N/A is excluded from scoring. It is not the same as a low-quality answer. 1 - No utility The answer gives no useful information. Examples: - Empty or off-topic response - Incoherent answer - Purely generic feedback such as “good”, “nice”, or “I like it” - No reason, detail, or actionable point This gives a decision-maker nothing to act on. 2 - Low quality The answer is on-topic but vague or superficial. Examples: - Basic sentiment without explanation - Generic reaction with no specifics - No clear reasoning - No useful detail tied to the question or stimulus This may show whether someone liked or disliked something, but not why. 3 - Moderate quality The answer includes a clear reaction and at least one concrete, decision-relevant point, but the reasoning is still thin or partly generic. Examples: - Mentions one specific strength or concern - Provides some explanation, but not much depth - Gives partial insight, but lacks enough detail to be highly useful This is usable, but limited. 4 - High quality The answer is specific, reasoned, and clearly tied to the question or stimulus. Examples: - Names a concrete strength, weakness, objection, or concern - Explains why it matters - Gives feedback a team could act on - Shows clear understanding of the context This is strong feedback that can support a real decision. 5 - Very high quality The answer is rich, specific, well-reasoned, and highly useful. Examples: - Provides a clear “why” behind the reaction - Surfaces a decision-relevant insight - Includes actionable implications - Is strongly grounded in the stimulus or question - Helps the team understand what to improve, keep, remove, or investigate further This is the kind of answer that can directly influence product, messaging, research, or business decisions. Ideal candidate You should be: - Strong at qualitative analysis - Comfortable evaluating written feedback - Detail-oriented and consistent - Able to follow a scoring rubric carefully - Experienced in research, writing, survey analysis, academic evaluation, UX research, market research, or similar work - Comfortable making judgment calls when answers are ambiguous