AI Agent Evaluation Developer for RAG
Worldwide
# AI Agent Evaluation Developer for RAG Document Workflow POC We are looking for a developer to build a small document agent and evaluate it using Braintrust or Plumloom. We will provide one large PDF or Markdown document. The agent should: * Answer questions about the document * Search the document multiple times when needed * Refine searches when evidence is incomplete * Generate a structured report or brief with citations * Capture the full agent trace Google ADK is preferred, but LangChain or another open-source framework is acceptable. You are free to design the chat interface using AI tools of your choice. ## Evaluation Work * Create 15 to 20 test cases * Define expected answers, report sections, or behavior * Evaluate correctness, grounding, completeness, citations, and search trajectory * Review failures and identify their cause * Turn important failures into regression tests * Re-run evaluations after changes * Show one before-and-after improvement * Document what the evaluation platform measures well and where it needs improvement ## Deliverables * Complete source code * Setup instructions * Working document workflow * Exported traces * Evaluation dataset and results * Short findings report *AI coding assistants are allowed. The developer must use their own model credentials.* Duration: 1 week --- *This will be a milestone-based project managed and paid through Upwork.*
$300.00
Fixed-price- IntermediateExperience Level
- Remote Job
- One-time projectProject Type
Skills and Expertise
Activity on this job
- Proposals:50+
- Last viewed by client:2 hours ago
- Interviewing:0
- Invites sent:0
- Unanswered invites:0
About the client
- United StatesFremont5:41 AM
- $38K total spent73 hires, 14 active
- Tech & ITSmall company (2-9 people)
Explore similar jobs on Upwork
How it works
Create your free profileHighlight your skills and experience, show your portfolio, and set your ideal pay rate.
Work the way you wantApply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
Get paid securelyFrom contract to payment, we help you work safely and get paid securely.
About Upwork
- 4.9/5(Average rating of clients by professionals)
- G2 2021#1 freelance platform
- 49,000+Signed contract every week
- $2.3BFreelancers earned on Upwork in 2020
Find the best freelance jobs
Growing your career is as easy as creating a free profile and finding work like this that fits your skills.
Trusted by