Senior Voice AI Engineer Needed — LiveKit Runtime and Multi-Agent Voice System

Posted yesterday

Worldwide

Summary

Senior Voice AI Engineer Needed — LiveKit Runtime and Multi-Agent Voice System We are looking for a senior engineer to build a production-grade voice AI runtime for enterprise customer-service bots. This is not a basic chatbot or simple STT → LLM → TTS project. The system will use LiveKit Agents and should support: * Real-time voice conversations * Interruptions and barge-in * A fast conversational LLM that speaks with the customer * A second LLM that searches documents and enterprise systems in parallel * Structured customer-service workflows * Tool calling with validation, retries, and idempotency * Policy enforcement before business actions * Response verification before speech is generated * Human handoff * Full tracing, latency, and cost monitoring Core Architecture Phone / Browser ↓ LiveKit Agents ↓ Session Supervisor ├── Conversation LLM ├── Research LLM ├── Workflow Engine ├── Policy Engine ├── Tool Gateway └── Response Verifier ↓ CRM / Billing / Ticketing / Knowledge Base Initial Scope The first version should include: * LiveKit voice session * Streaming STT and TTS * Turn detection and interruptions * Session state management * Parallel research jobs * One structured customer-service workflow * Five to ten mock tools * Tool validation and retry handling * Response verification * Full event tracing * Automated tests Preferred Skills * Python * LiveKit Agents * Asyncio * Real-time voice systems * WebRTC or telephony * LLM tool calling * Multi-agent or supervisor architecture * FastAPI * Redis * PostgreSQL * Temporal * OpenTelemetry Experience with Pipecat, Vapi, Retell, Twilio Media Streams, or native audio models is a plus. Who Should Apply Please apply only if you have built real-time voice or agent infrastructure before. We are not looking for someone whose experience is limited to: * Prompt engineering * Basic chatbots * No-code voice-agent platforms * Simple Twilio integrations * Basic RAG demos When Applying Please include: 1. Relevant voice AI or real-time systems you have built 2. Your experience with LiveKit Agents 3. How you would manage two LLMs working in parallel during a live call 4. How you would prevent duplicate or unsafe tool execution 5. Links to relevant GitHub repositories or demos

  • $8,000.00

    Fixed-price
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type

Contract-to-hire opportunity

This lets talent know that this job could become full time.
Learn more
Skills and Expertise
Mandatory skills
live kit
Activity on this job
  • Proposals:50+
  • Last viewed by client:6 hours ago
  • Interviewing:
    6
  • Invites sent:
    3
  • Unanswered invites:
    0
About the client
Member since Jul 4, 2021
  • United States
    San Francisco3:23 AM
  • $318K total spent
    75 hires, 35 active
  • 218 hours

Explore similar jobs on Upwork

Speech recognitionHourly‐ Posted 2 days ago
Conversational AI
Artificial Intelligence
Natural Language Processing
AI Agent Development
ElevenLabs
Python
Node.js
ChatGPT API
Whisper AI
Whisper API
AI Speech-to-Text
AI Text-to-Speech
AI Audio Generation
Twilio API
AI Ledger Viewing SolutionHourly‐ Posted 3 weeks ago
Adobe Illustrator
VectorWorks
Illustration
Cartoon Art

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo