AI Agent Developer Needed – Multi-Model Voice & Chat System (Claude, OpenAI, RAG)

Posted 4 hours ago

Worldwide

Summary

I need an AI Agent Developer to build an autonomous assistant that handles both phone calls and website chat, pulling answers from our documents and routing each query to whichever AI model — Claude or OpenAI — gives the best result. The system should work as one unified agent behind two channels: voice (via Twilio and Retell AI) and chat, both backed by the same RAG-powered knowledge base. When the agent isn't confident in an answer, it should automatically trigger a workflow (via n8n or Zapier) to escalate to a human instead of guessing. What I need built: An AI agent architecture (Python, FastAPI) powering both voice and chat channels from one backend Voice AI agent for real phone calls (Twilio + Retell AI) CRM integration with GoHighLevel for escalated conversations and lead capture Chat AI agent for website/messaging, sharing the same logic and knowledge base Multi-model routing between Claude API and OpenAI API based on query type RAG pipeline with a vector database (Pinecone) for document-based retrieval Automated escalation workflow (n8n or Zapier) for low-confidence responses Call transcripts and basic performance/analytics tracking Clean API layer and documentation for future integrations (CRM-ready) Ideal skills: AI Agent Development — building autonomous, multi-channel systems, not single-purpose bots Claude API and OpenAI API integration, with model-routing logic Voice AI (Twilio, Retell AI) RAG architecture and vector search GoHighLevel (GHL) integration Python, FastAPI n8n or Zapier workflow automation CRM/API integration experience a plus Deliverables: Unified AI agent system covering both voice and chat Multi-model routing logic (Claude + OpenAI) RAG knowledge base with Pinecone Automated escalation workflow Documentation and handover support

  • $100.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Claude
n8n
GoHighLevel
FastAPI
Activity on this job
  • Proposals:20 to 50
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jul 24, 2026
  • United Arab Emirates
    Dubai1:46 AM

Explore similar jobs on Upwork

Multiplayer Card gameHourly‐ Posted 2 weeks ago
Native App Development
AngularJS
TypeScript
Node.js
JavaScript
React
MongoDB
MySQL
Amazon Web Services
Redis
Socket.io
Web Design
ExpressJS
NodeJS Framework
Game Development
RESTful API
Python
Database Development
Microsoft Excel
Data Processing
CRM Development

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo