AI Voice Agent Developer — Twilio + OpenAI Realtime API + Authorize.net (Service/Delivery Business)

Posted yesterday

Only freelancers located in the U.S. may apply.U.S. located freelancers only

Summary

Title: AI Voice Agent Developer — Twilio + OpenAI Realtime API + Authorize.net (Service/Delivery Business) Category: AI Voice Agents / Twilio Development / Backend Integration Job Description: We run a service business (heating oil delivery, service calls, and free estimates) that currently handles all inbound calls manually — taking orders, scheduling, and processing payments by hand, logging everything into Google Docs. We want to build a self-hosted AI voice agent to automate this, and we're looking for a developer to build it with us. What we have already: 90+ phone numbers on Twilio, plus 2 landlines on Optimum Online, currently all forwarded to Grasshopper Authorize.net account already integrated on our website (API Login ID / Transaction Key available) Two separate websites/platforms for heating oil delivery — one for same-day delivery (higher price), one for scheduled delivery (lower price) — each with its own pricing Google Docs currently used for logging orders, estimates, and service calls What we want built: What we want built: Route Twilio numbers away from Grasshopper to a custom voice agent server (Twilio Media Streams + a realtime AI model — we're leaning toward OpenAI's Realtime API) Call flow that can identify caller intent: heating oil order, free estimate, or service call For estimates and service calls: schedule appointments by checking calendar availability — no payment involved on these calls For heating oil orders only: determine same-day vs. scheduled delivery, pull the correct price from the matching platform/pricing table, quote the total, and confirm quantity before payment Self-service "block myself out" capability — a simple way for us (owner/dispatcher) to mark ourselves unavailable when overbooked, so the AI automatically stops offering same-day/next-day slots (for both estimates/service calls and oil delivery) and either pushes callers to the next open slot or takes a callback request instead. Needs to be something we can toggle quickly (a shared calendar block, a simple dashboard, or even a phone/text command) — not something requiring a developer each time. Phone payment capture — for heating oil orders only — via DTMF keypad entry for card number/expiry/CVV (never passed through the AI model), submitted to Authorize.net for charge, using the price from whichever of the two platforms (same-day or scheduled) matches the order Automatic logging of every completed call (order/estimate/service booking) to Google Sheets (preferred over Docs for structure), including a fallback "transfer to human" option Handle 2 Optimum Online numbers via call forwarding into the Twilio system Important: We specifically do NOT want a per-minute AI platform (Retell, Vapi, Bland, etc.) — we want to own the code and infrastructure directly, paying only Twilio and the AI model provider for usage. We have a written architecture/build guide already (happy to share on request) covering the full phase-by-phase plan — you'd be implementing against it, not starting from a blank page. Ideal experience: Twilio Programmable Voice + Media Streams (not just SMS) Direct integration with a realtime voice AI model (OpenAI Realtime API or similar) — not just wrapping a no-code platform Authorize.net API integration, ideally with DTMF/PCI-aware payment flows Google Sheets/Docs and Google Calendar API for logging and availability control Comfortable handing off clean, documented code we can maintain going forward Engagement structure: We'd like to start with a fixed-price proof-of-concept phase: one Twilio number, basic oil order flow (intent → correct price from same-day or scheduled platform → log to Sheet, no payment yet). If that goes well, we'll extend the same contract to cover payment integration, scheduling with overbooking controls, and full rollout across our numbers. To apply, please include: Relevant past projects (especially Twilio voice + AI, and any payment-over-phone or calendar-aware booking work) Your proposed approach/timeline for the proof-of-concept phase Your rate (hourly or fixed-price estimate for POC phase)

  • More than 30 hrs/week
    Hourly
  • 1-3 months
    Duration
  • Expert
    Experience Level
  • Remote Job
  • Ongoing project
    Project Type
Skills and Expertise
Mandatory skills
Twilio API
Authorize.Net
Activity on this job
  • Proposals:20 to 50
  • Interviewing:
    0
  • Invites sent:
    0
  • Unanswered invites:
    0
About the client
Member since Nov 30, 2019
  • United States
    Riverhead2:04 PM
  • $540 total spent
    2 hires, 1 active
  • 22 hours
  • Mid-sized company (10-99 people)

Explore similar jobs on Upwork

Add Tree Adoption Feature to WordPressFixed-price‐ Posted 2 months ago
WordPress
PHP
HTML5
CSS
JavaScript
Node.js
PHP
Web Application
AI App Development
DevOps
API
Git
MySQL

How it works

  • Post a job icon
    Create your free profile
    Highlight your skills and experience, show your portfolio, and set your ideal pay rate.
  • Talent comes to you icon
    Work the way you want
    Apply for jobs, create easy-to-by projects, or access exclusive opportunities that come to you.
  • Payment simplified icon
    Get paid securely
    From contract to payment, we help you work safely and get paid securely.
Want to get started? Create a profile

About Upwork

  • Rating is 4.9 out of 5.
    4.9/5
    (Average rating of clients by professionals)
  • G2 2021
    #1 freelance platform
  • 49,000+
    Signed contract every week
  • $2.3B
    Freelancers earned on Upwork in 2020

Find the best freelance jobs

Growing your career is as easy as creating a free profile and finding work like this that fits your skills.

Trusted by

  • Microsoft Logo
  • Airbnb Logo
  • Bissell Logo
  • GoDaddy Logo