AI Agent Evaluation Developer for RAG

Posted 2 hours ago

Worldwide

Summary

# AI Agent Evaluation Developer for RAG Document Workflow POC We are looking for a developer to build a small document agent and evaluate it using Braintrust or Plumloom. We will provide one large PDF or Markdown document. The agent should: * Answer questions about the document * Search the document multiple times when needed * Refine searches when evidence is incomplete * Generate a structured report or brief with citations * Capture the full agent trace Google ADK is preferred, but LangChain or another open-source framework is acceptable. You are free to design the chat interface using AI tools of your choice. ## Evaluation Work * Create 15 to 20 test cases * Define expected answers, report sections, or behavior * Evaluate correctness, grounding, completeness, citations, and search trajectory * Review failures and identify their cause * Turn important failures into regression tests * Re-run evaluations after changes * Show one before-and-after improvement * Document what the evaluation platform measures well and where it needs improvement ## Deliverables * Complete source code * Setup instructions * Working document workflow * Exported traces * Evaluation dataset and results * Short findings report *AI coding assistants are allowed. The developer must use their own model credentials.* Duration: 1 week --- *This will be a milestone-based project managed and paid through Upwork.*

  • $300.00

    Fixed-price
  • Intermediate
    Experience Level
  • Remote Job
  • One-time project
    Project Type
Skills and Expertise
Mandatory skills
Artificial Intelligence
Activity on this job
  • Proposals:50+
  • Last viewed by client:1 hour ago
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Dec 15, 2020
  • United States
    Fremont4:52 AM
  • $38K total spent
    73 hires, 14 active
  • Tech & IT
    Small company (2-9 people)

Explore similar jobs on Upwork

Gen AI Developer (Contract)Fixed-price‐ Posted 3 months ago
AI Agent Development
Python
JavaScript
API
Node.js
Deep Learning
React
PostgreSQL
Agentic AI Engineer for Mechanical DesignFixed-price‐ Posted 3 weeks ago
CAD
Drafting
Mechanical Engineering
Eagle

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo