Software Engineer Needed for LLM Evaluation Tool Usability Study

Posted 5 days ago

Worldwide

Needs to hire 6 Freelancers
Summary

Software Engineer Needed for LLM Evaluation Tool Usability Study I’m looking for a software engineer who has built a web application that integrates with an LLM (OpenAI, Anthropic, Gemini, etc.) and already uses evaluations to test or improve AI quality. During a 60-minute Zoom session, you’ll use your own application to evaluate an LLM observability and evaluation platform. You’ll sign up, integrate the SDK (feel free to use Cursor, Claude Code, Codex, or another coding agent to speed things up), connect your application, import or create evaluations, and think out loud as you work. I’m interested in understanding where the onboarding experience is confusing or could be improved. Requirements * You have an existing web application that integrates with an LLM * You have written or regularly run evaluations for your AI application * You’re comfortable integrating a new SDK into your application * Any language or framework is fine What we’ll do * 45 minutes: Integrate the platform while sharing your screen and thinking out loud * 15 minutes: Discuss your experience and feedback

  • Less than 30 hrs/week
    Hourly
  • < 1 month
    Duration
  • Intermediate
    Experience Level
  • $15.00

    -

    $30.00

    Hourly
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Nice-to-have skills
Manual Testing
Activity on this job
  • Proposals:15 to 20
  • Last viewed by client:4 days ago
  • Hires:
    2
  • Interviewing:
    6
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jun 24, 2026
  • United States
    San Francisco3:11 PM
  • $47 total spent
    2 hires, 2 active
  • 1 hours
  • Tech & IT
    Individual client

Explore similar jobs on Upwork

Paid Interview: LangSmith Fleet UsersHourly‐ Posted 3 weeks ago
LangChain
Noloco specialistHourly‐ Posted 2 weeks ago

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo