AI Evaluation Protocol Engineer (AI Systems + Blockchain)

Posted 2 days ago

Worldwide

Summary

The product is not a research memo and not a generic chatbot. It is a working system where operators stake compute, run model evaluation, publish scored results, and settle fees / yield on-chain. We need one developer who can own both sides of that loop: AI — the evaluation methodology, scoring, and job pipeline Blockchain — wallets, staking, settlement, and on-chain proof of those results If you only do ML, the scores never become a market. If you only do Web3, the tokens have nothing real behind them. This role exists because those two pieces have to be designed together. Current AI evaluation is closed, inconsistent, and hard to verify. Different models are scored with different methods, results are easy to fake, and there is no shared ledger for who ran the job, what score was produced, or who gets paid. Stake NXR into evaluation / compute pools Run structured evaluation jobs (benchmarks, scoring, comparison) Publish results as tradable evaluation output / licenses Settle evaluation fees, staking yield, and royalties on-chain We already have a React + Express product shell (marketplace, evaluation studio, staking/trading UI, AI image preview). We do not yet have the real evaluation engine or the on-chain settlement layer. That is the work. What you will do Review existing AI evaluation standards and identify gaps we must cover Design a practical evaluation methodology that works across model types (LLM, vision, agents) Define a scoring framework, result schema, and reporting structure Design how an evaluation result is attested and written on-chain (who ran it, inputs, score, timestamp) Specify the blockchain flows this product depends on: wallet connect, staking pools, evaluation listing, settlement, and claim Turn the above into an actionable build plan we can implement against the existing codebase Must-have experience

  • Less than 30 hrs/week
    Hourly
  • 6+ months
    Duration
  • Intermediate
    Experience Level
  • $30.00

    -

    $57.00

    Hourly
  • Remote Job
  • Complex project
    Project Type
Skills and Expertise
Mandatory skills
Node.js
Machine Learning
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:yesterday
  • Interviewing:
    8
  • Invites sent:
    3
  • Unanswered invites:
    1
About the client
Member since Sep 5, 2026
  • Indonesia
    11:29 AM

Explore similar jobs on Upwork

Forward Deployed AI EngineerFixed-price‐ Posted 4 weeks ago
Python
Artificial Intelligence
LangChain
Cloud Code Programming MentorHourly‐ Posted 3 weeks ago

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo