Korean Industry Professionals Needed to Create Real-World AI Benchmark Tasks

Posted yesterday

Worldwide

Summary

Job Description We are building a high-quality Korean-language dataset of realistic professional work tasks for evaluating advanced AI systems. We are looking for professionals with real work experience in South Korea across a wide range of occupations and industries. This is not a general translation, annotation, or content-writing project. We want contributors who understand the actual work performed in their profession and can create realistic tasks that someone in that occupation could encounter in their day-to-day work. Examples of professionals we are interested in include: Accountants and auditors Financial analysts Business analysts Engineers Software and IT professionals Project managers Operations professionals HR professionals Marketing professionals Sales professionals Supply chain and logistics professionals Manufacturing professionals Architects Designers Researchers Healthcare professionals Legal professionals Education professionals Journalists and communications professionals Insurance professionals Real-estate professionals Consultants Other skilled professional occupations We are particularly interested in people who have practical professional experience in the Korean workplace. What You Will Do You will create realistic professional tasks based on the type of work performed in your occupation. A complete task may include: Task / Prompt A realistic instruction or assignment that could be given to someone working in your profession. For example: You are a financial analyst at a Korean manufacturing company. Using the attached quarterly financial information, prepare a management analysis identifying the main drivers of the change in operating margin and recommend three areas management should investigate. Supporting Materials Where appropriate, you may create supporting files such as: Excel spreadsheets Tables Reports PDFs Internal-style memos Business documents Charts Data files Policies or procedures Images Other realistic reference materials Supporting materials must be created specifically for the task, based on public information, or otherwise legally usable. Do not use confidential, proprietary, personal, or internal documents belonging to your current or previous employers. Expected / Expert Answer You will prepare an example of what a strong professional-quality response to the task should look like. This could be: A written analysis Report Spreadsheet Presentation Recommendation Calculation Business document Technical output Other deliverable normally produced in your occupation Evaluation Criteria / Rubric You will explain how the response should be evaluated. For example: Correctness of calculations Identification of important findings Completeness Appropriate use of the provided information Professional reasoning Compliance with relevant Korean practices or regulations Quality of recommendations Important: Tasks Must Reflect Real Korean Professional Work We are not looking for generic questions such as: "Explain what financial analysis is." Instead, we want realistic work assignments such as: "Review the attached financial statements and prepare a management memo explaining the three main causes of the decline in gross margin." The task should require professional judgment, analysis, or creation of a meaningful work product. Where relevant, tasks should reflect the Korean business, regulatory, cultural, or professional context. Who We Are Looking For You should ideally have: Professional work experience in your stated occupation Strong knowledge of how the profession operates in South Korea Excellent Korean writing skills Ability to create realistic professional scenarios Good attention to detail Ability to explain what constitutes a high-quality professional output 5+ years of professional experience is preferred, although highly qualified candidates with less experience may also be considered. AI or data annotation experience is not required. We value your professional expertise more than your experience working on AI projects. Language Tasks will primarily be written in Korean. You should therefore have excellent professional Korean writing skills. English proficiency sufficient to understand project instructions is helpful. Initial Paid Pilot Selected professionals will first complete one paid pilot task. The pilot will allow us to evaluate: Realism of the task Professional depth Quality of supporting materials Quality of the expected answer Quality of the evaluation criteria Korean localization Overall attention to detail Professionals who perform well may be invited to create multiple additional tasks and participate in ongoing projects. Compensation This is paid project-based work. For complete high-quality tasks, including the task, supporting materials where required, expert answer, and evaluation rubric, we expect compensation to generally fall in the range of: USD $250 per accepted task, depending on the occupation and complexity. More specialized or senior professional domains may receive higher compensation. Final pricing can be agreed with selected contributors. Please see a sample attached in English language

  • $250.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Engineering & Architecture
Activity on this job
  • Proposals:5 to 10
  • Last viewed by client:11 hours ago
  • Hires:
    1
  • Interviewing:
    1
  • Invites sent:
    30
  • Unanswered invites:
    25
About the client
Member since Oct 3, 2025
  • USA
    Newark2:23 PM
  • $1.4K total spent
    19 hires, 4 active
  • 38 hours

Explore similar jobs on Upwork

Multi-State Real Estate BrokerHourly‐ Renewed 2 months ago
Real Estate
Broker's Price Opinion
Stakeholder Influence Webinar HostHourly‐ Posted 1 month ago
Leadership Coaching
Leadership Development
Communication Strategy
Communications Development & Testing
Communications

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo