AI Evaluation Protocol Engineer (AI Systems + Blockchain)
Worldwide
The product is not a research memo and not a generic chatbot. It is a working system where operators stake compute, run model evaluation, publish scored results, and settle fees / yield on-chain. We need one developer who can own both sides of that loop: AI — the evaluation methodology, scoring, and job pipeline Blockchain — wallets, staking, settlement, and on-chain proof of those results If you only do ML, the scores never become a market. If you only do Web3, the tokens have nothing real behind them. This role exists because those two pieces have to be designed together. Current AI evaluation is closed, inconsistent, and hard to verify. Different models are scored with different methods, results are easy to fake, and there is no shared ledger for who ran the job, what score was produced, or who gets paid. Stake NXR into evaluation / compute pools Run structured evaluation jobs (benchmarks, scoring, comparison) Publish results as tradable evaluation output / licenses Settle evaluation fees, staking yield, and royalties on-chain We already have a React + Express product shell (marketplace, evaluation studio, staking/trading UI, AI image preview). We do not yet have the real evaluation engine or the on-chain settlement layer. That is the work. What you will do Review existing AI evaluation standards and identify gaps we must cover Design a practical evaluation methodology that works across model types (LLM, vision, agents) Define a scoring framework, result schema, and reporting structure Design how an evaluation result is attested and written on-chain (who ran it, inputs, score, timestamp) Specify the blockchain flows this product depends on: wallet connect, staking pools, evaluation listing, settlement, and claim Turn the above into an actionable build plan we can implement against the existing codebase Must-have experience
- Less than 30 hrs/weekHourly
- 6+ monthsDuration
- IntermediateExperience Level
$30.00
-
$57.00
Hourly- Remote Job
- Complex projectProject Type
Skills and Expertise
Activity on this job
- Proposals:20 to 50
- Last viewed by client:yesterday
- Interviewing:8
- Invites sent:3
- Unanswered invites:1
About the client
- Indonesia11:29 AM
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by