Audio and Language Evaluator — English (Great Britain)

Overview We are seeking native-level English (Great Britain) speakers to support evaluation and annotation work for voice AI. Projects span text-to-speech audio evaluation, data annotation, transcript review, and linguistic analysis. You will assess outputs using structured rubrics and provide written feedback in English. About the Role The work varies across projects. Some examples of what you may be asked to do: - Listen to AI-generated audio samples in your language and rate them across multiple quality dimensions using a provided rubric. - Compare pairs of audio samples and indicate which you prefer, along with how strong your preference is. - Review and annotate transcripts for accuracy, segmentation, or linguistic features. - Complete data annotation tasks that involve labeling, categorizing, or flagging content according to provided guidelines. - Write short English-language feedback explaining your ratings, describing what you heard, and noting specific issues. Rubrics cover quality dimensions such as pronunciation, pacing, intonation, emotion, and speaker similarity, among others. Each task comes with specific instructions outlining what to assess and how to apply the rubric. Each task includes evaluation guidelines and a rubric that define the required output. Contractors apply the rubric to produce ratings and written feedback that meet the specifications for each task and ensure ratings are aligned across the team. This means carefully reading the guidelines for each task, asking clarifying questions when something is unclear, and applying the same standards throughout your work. Tasks include reference examples so contractors can confirm their output meets the rubric specifications. Volume Up to 20 hours per week. Volume varies by language and project. Some weeks may have less than 20 hours of work available. We occasionally hold optional team meetings. Contractors may be asked to acknowledge new assignments within a stated window. Availability on weekends is a plus. Typical turnaround for a task is 24 hours from assignment. Larger tasks (100+ samples) will have extended deadlines. Some tasks are planned in advance; others are ad hoc with tighter turnaround. Requirements - Native-level proficiency in English as spoken in the UK. - Strong written English proficiency. You will write feedback, read guidelines, and communicate with the team in English. - Foundational knowledge of linguistics or a related field. You should be comfortable with concepts like phonetics, prosody, and intonation, and be able to apply them when evaluating speech. Formal education in linguistics, language studies, or speech science is a strong plus. - Reliable internet connection, a computer with audio playback, and headphones. - Ability to follow detailed guidelines precisely and maintain consistent quality across tasks. - Task assignments and clarifications are handled through a Slack workspace. - Responsive and available within the turnaround windows described above. - Engaged and communicative. We value evaluators who ask questions, flag issues, and actively participate. - Resourceful and self-sufficient. If you're waiting on a response from one team member, you reach out to others or find another way to make progress. We need people who keep moving and don't stall when something is unclear. Preferred - Prior experience with data annotation, transcription, or linguistic evaluation. Candidates with hands-on annotation experience will be given strong consideration. - Conversational spoken English proficiency. All instructions, guidelines, and team communication are in English, and some meetings may be conducted in English. - Schedule that overlaps with Pacific time business hours. Weekend availability is a plus. - Familiarity with structured rubrics or rating scales. - Experience working with distributed, remote teams. How to Apply In your application, please include: - Relevant experience. Describe any prior work in data annotation, transcription, audio evaluation, linguistics, or related fields. Be specific about the type of work, your role, and any linguistic training or education you have. - Language proficiency. List the languages you speak and your proficiency level in each. Indicate which is your native language. - Availability. Confirm you can commit up to 20 hours per week and are available to begin promptly. Candidates who move forward will complete a short interview and a screening task as part of the evaluation process. This is a 1099 contract opportunity. Evaluators work on a non-exclusive, project-by-project basis, control their own methods and schedule for completing assigned tasks, supply their own equipment, and are responsible for their own taxes. You must be authorized to work in your country of residence.