Voice AI: real-time voice agents
10
Glossary and sources
7 min read · Chapter 10 of 10
Words that mean something else here
| Term | What you'd assume | What it means here |
|---|---|---|
| Latency | One number | At least six: model inference, first audio, first token, end of turn, the platform's turn gap and mouth to ear. Ask which, and at which percentile |
| Realtime | Instant | OpenAI's product name, any streaming speech-to-speech model, or loosely anything under a second |
| Interruption | The caller cutting in | Either direction: the caller interrupting the agent (wanted) or the agent cutting off the caller (not wanted); an "interrupt rate" can mean either |
| Handoff | Passing to a person | Usually a transfer, by SIP; in agent frameworks, a switch to another AI agent |
| Agent | The AI | An AI agent, a human contact center agent, or in SIP any endpoint. In "transfer to an agent", it's the human |
| Minute | Sixty seconds of a call | Carrier minutes, stream time with silence, audio tokens, or minutes of generated speech; "$0.05 a minute" can cover very different scope |
| Containment | Resolution | Calls not transferred to a person, abandoned calls included |
| Artificial voice | Robotic-sounding | Under the TCPA, any AI-generated or cloned voice, a live conversational agent included |
| Attestation A | The call is legitimate | The carrier vouches for the customer's right to the number, not the voice or the content |
| Transcript | What the model read | In a chained stack, yes; in speech-to-speech, a separate recognizer's guess at what was said |
What surprised me
Placeholders in your voice, drafted from the research and the earlier guides. Rewrite each with your own moment.
The rate deck. In telco I could multiply minutes by a price per minute. Here one four-minute call is metered five ways by five vendors, and on a speech-to-speech model the fifth minute costs more than the first.
"Faster means better." The fastest agents in the benchmark still got about half the tasks wrong on phone audio. Speed got them into the conversation and logic decided the outcome.
"Inbound is the safe side." The TCPA barely touches calls the business answers, and then a California court treated the AI vendor on the line as an eavesdropper.
Caller ID. In the telco guide, attestation was a technical detail. In the Biden robocall it was the one penalty that got paid.
"The cheap part is the AI." The AI minute was a rounding error next to the human minutes that follow every call it can't finish.
Sources
Undated entries were read on October 8, 2026; "search result" means seen only as a search snippet or summary. Company figures are self-reported unless they come from a filing or a regulator, and vendor benchmarks measure the vendor's own products or customers.
Regulators, laws and courts
- FCC: declaratory ruling 24-17 on AI voices (Feb 2024); notice of proposed rulemaking 24-84 (Aug 2024, search result); public notice DA 26-940 on political AI calls (Sep 2026); Lingo Telecom settlement (Aug 2024, search result)
- Fake-Biden robocall: Cyberscoop, Lingo agrees to $1 million (Aug 2024, search result); NBC Boston, the unpaid fine (Nov 2025); NHPR/AP, acquittal (Jun 2025, search result); NBC News, how the clip was made (Feb 2024, search result)
- TCPA courts and litigation: Steptoe, McLaughlin v. McKesson (Jun 2025, search result); TCPAWorld, class actions up 95% (Jul 2025, search result) and the suit naming OpenAI and Twilio (Dec 2025, search result), class actions through October 2025 (Dec 2025, search result) and a record February 2026 (Apr 2026); Inman, suit against a mortgage lender (Feb 2026, search result); Sheppard Mullin, AI robocalls and Texas (Jul 2026, search result)
- Consent rules (via the telco research): Federal Register, revocation rules (Oct 2024); Goodwin, one-to-one consent eliminated (Sep 2025); TransNexus, third-party signing rule (Aug 2025); TLP, SIP 603+ and blocking (Mar 2025); Hiya, FreeCallerRegistry
- State laws: Maine, 10 MRSA §1500-DD; California, Public Utilities Code §2874 (search result); Future of Privacy Forum, Utah's AI law (search result); Rev, recording laws by state (vendor, search result)
- California wiretap suits: Ambriz v. Google order (Feb 2025, search result) and case tracker (Sep 2026); Duane Morris, Taylor v. ConverseNow (Aug 2025, search result)
- Biometrics: Biometric Update, Pindrop exempt from BIPA (Aug 2026); National Law Review, voiceprints, vendors and the exemption (Sep 2026, search result); Capitol News Illinois, suits over training voices (May 2026, search result)
- EU AI Act: Jones Walker, August 2 still matters (Jul 2026)
- Health and cards: ElevenLabs, HIPAA (vendor, search result); Vapi support, HIPAA compliance (vendor, search result); PCI Security Standards Council, protecting telephone-based payment card data (Nov 2018, search result)
- Canada: CRTC, consultation 2026-132 (Jun 2026, search result); M3AAWG, comments on the consultation (Jul 2026)
- Spain's customer service law: La Moncloa, Ley de Servicios de Atención a la Clientela (2025, read Oct 2026); Forbes España, final approval (2025, search result)
- FTC: DLA Piper, the Air AI case (Aug 2025, search result)
- Liability: McCarthy Tétrault, Moffatt v. Air Canada (2024)
Labs and speech model companies: documentation and pricing
- OpenAI: gpt-realtime, gpt-realtime-2.1, GPT-Live-1, voice activity detection, realtime costs, SIP, WebRTC, voice agents, pricing, synthetic voices (Mar 2024, search result); agents SDK issue on guardrails (search result); AI Weekly, GPT-Live-1 in the API (Sep 2026, search result); DataNorth, gpt-realtime-2.1 (Jul 2026, search result); OpenAI community, December 2024 price cut (search result)
- Google: Gemini API pricing; Firebase, Live API limits (Oct 2026); TechCrunch, Google and Hume AI (Jan 2026, search result)
- Meta: Bloomberg, Meta acquires PlayAI (Jul 2025, search result); AudioStack, PlayHT deprecation notice (Jul 2025, search result)
- ElevenLabs: latency, API pricing, $22 billion tender (Sep 2026), price cut for agents (Feb 2025), startup grants (Aug 2025); AI Weekly, ARR and tender (Sep 2026, search result); usagepricing.com, ElevenLabs price tracker (Oct 2026)
- Deepgram: pricing, startup program (Oct 2026), Flux; TechCrunch, Series C (Jan 2026, search result)
- AssemblyAI: pricing, Universal-Streaming (search result)
- Cartesia: pricing; Sacra, Cartesia (search result)
- Gladia: OVHcloud, Gladia acquisition (2026, search result)
Telephony and voice agent platforms
- Twilio: latency guide for AI voice agents (Nov 2025), Media Streams messages, US voice pricing (Aug 2026), ConversationRelay pricing (search result), answering machine detection (search result), Q2 2026 results (Aug 2026); Futurum, Twilio Q2 2026 (Aug 2026, search result); CMSWire, AI customers spending more (2026, search result)
- Telnyx: voice AI pricing, voice AI (search result)
- Bandwidth: Q2 2026 results (Jul 2026); MarketBeat, Q2 call highlights (Jul 2026, search result)
- Vonage: Light Reading, Ericsson's Vonage revival plan (Aug 2026)
- Vapi: pricing, startup program (Oct 2026), terms of service (Sep 2026), understanding latency, call timeout settings (search result), Humanness Index (Jun 2026, vendor); TechCrunch, Vapi at $500 million (May 2026, search result)
- Retell: pricing, terms of service (Jun 2026); Sacra, Retell revenue estimate (Apr 2026)
- Bland: pricing, Series B (2025, search result); Lindy, Bland's pricing change (search result)
- LiveKit: Cloud plans (Oct 2026); Fortune, Series C (Jan 2026, search result); transfers documentation (search result)
- Pipecat: Smart Turn (search result) and its documentation (search result); GitHub star counts read through the GitHub API (Oct 2026)
- Noise and turn detection vendor: BusinessWire, noise and voice isolation launch (Jul 2025, vendor, search result)
Finished agents, contact centers and deals
- Sierra: Let's Data Science, Series E (May 2026); VKTR, Fortune 50 claim (May 2026, search result)
- Decagon: Bloomberg, valued at $4.5 billion (Jan 2026, search result); Decagon, AWS Marketplace listing (Jul 2026)
- Parloa: TechCrunch, $3 billion valuation (Jan 2026, search result); IT Brief, $50 million ARR (Jun 2026, search result); Parloa, customer examples (vendor, search result)
- PolyAI: Series D (Dec 2025, search result); PG&E case study (vendor); VCA, customers named in the Series D (Dec 2025, search result)
- Fin and Salesforce: Fin pricing; The Next Web, Salesforce acquires Fin (Jun 2026, search result)
- NICE: Q2 2026 results (Aug 2026); Call Centre Helper, Cognigy acquisition completed (Sep 2025, search result)
- Genesys: pricing (Oct 2026, page partly read), AI token billing (search result); Intelligent CIO, Q2 FY2027 (Sep 2026, search result)
- Five9: Q2 2026 results, 8-K exhibit 99.1 (Aug 2026); pricing (Oct 2026)
- Amazon Connect: pricing (Oct 2026)
- Outsourcers: Teleperformance, Q1 2026 revenue (Apr 2026); Quartr, Teleperformance H1 2026 (Jul 2026, search result); MarketBeat, Concentrix Q3 2026 call (Sep 2026, search result)
- Procurement data (one broker, self-selected buyers): Vendr, Decagon (undated), Genesys (Feb 2026), Twilio (Feb 2026), ElevenLabs (Feb 2026)
- Funding: AI Weekly, voice AI funding in Q1 2026 (Aug 2026, relaying the Financial Times)
Voice security and fraud
- Pindrop: Latham & Watkins, growth financing (Jul 2024, search result); CIO Influence, 2025 voice intelligence report (Jun 2025, vendor, search result)
- Reality Defender: FinTech Global, $33 million (Oct 2024, search result)
- Hiya: State of the Call 2026 (Mar 2026, vendor, search result); BusinessWire, branded calling with Deutsche Telekom (Jan 2026, vendor, search result)
- Bank voice ID: IT Brew, voice AI beats a bank's voice ID (Mar 2023, search result); Local10/AP, OpenAI's CEO on voice fraud (Jul 2025, search result)
- Fraud cases: CFO Dive, Arup (2024, search result); Sophos, the 2019 CEO voice case (search result); Senseient, the UAE bank case (search result); SecureWorld, FBI IC3 2025 AI losses (Apr 2026, search result)
Benchmarks, research and outcomes
- Ray and colleagues, τ-Voice (Mar 2026); Artificial Analysis, Speech to Speech Index (Jun 2026); NVIDIA, VoiceChat (2026, search result)
- Stivers and colleagues via Language Log, turn-taking across languages (2009 paper, search result); ITU-T, G.114 (2003, search result); Koenecke and colleagues, racial disparities in speech recognition (2020, search result)
- Luo and colleagues, disclosing chatbots in sales calls (2019, search result)
- Gartner: 14% resolved in self-service (Aug 2024, search result); 64% prefer no AI (Jul 2024, search result); half will abandon headcount cuts (Jun 2025, search result); cost per resolution by 2030 (Jan 2026, title only); 87% want access to a person (Aug 2026, search result); AI spending up 38% (Aug 2026, search result); Customer Experience Dive, the same survey (Aug 2026, search result)
- Qualtrics, AI customer service fails at four times the rate (Oct 2025, search result)
- Pull-backs: ABC News/AP, McDonald's ends its AI drive-thru test (Jun 2024, search result); TechSpot, Taco Bell slows down (Aug 2025, search result); Bloomberg, Commonwealth Bank reverses job cuts (Aug 2025, search result); Fortune, Klarna hires humans again (May 2025, search result)
- Human cost: US Bureau of Labor Statistics, customer service representatives (May 2025 data); Outsource Accelerator, cost per call (search result)
Field Guides are learning notes, not legal or compliance advice. Rules and fees change; check the cited primary sources before you act on anything here.