Real-time conversational voice AI engineer (ElevenLabs, WebRTC) — fix orb states + latency

Posted yesterday

Worldwide

Summary

I'm building an AI language-learning app where users have spoken conversations with an AI tutor shown as a voice "orb" (beginner/intermediate/advanced levels and roleplay). I need an experienced real-time conversational voice AI engineer to diagnose and fix specific issues. This is in-app voice over WebRTC/WebSockets — NOT phone or telephony call agents, and NOT general app development. Two problems: (1) the orb's "listening" and "talking" states glitch and don't switch cleanly, and (2) noticeable latency, plus occasional AI hallucinations that drift off the lesson. Must have hands-on experience with: ElevenLabs Conversational AI, LiveKit or Pipecat, real-time turn-taking and barge-in handling, and RAG for grounding. Please share a link to a LIVE in-app voice product you've built (not just a demo). Starting with a small paid diagnostic — a few hours to reproduce the issues and tell me the root cause and your fix — with ongoing work likely after.

  • Less than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Intermediate
    Experience Level
  • $50.00

    -

    $120.00

    Hourly
  • Remote Job
  • Ongoing project
    Project Type
  • Contract-to-hire
    This job has the potential to turn into a full time role
Skills and Expertise
Mandatory skills
WebRTC
Python
Artificial Intelligence
Activity on this job
  • Proposals:20 to 50
  • Last viewed by client:yesterday
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Jun 28, 2026
  • Bulgaria
    10:31 AM

Explore similar jobs on Upwork

Paid Interview: LangSmith Fleet UsersHourly‐ Posted 2 weeks ago
LangChain
Noloco specialistHourly‐ Posted 2 weeks ago

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo