The Platform PM

Common mistakes

Field Guide

Voice AI: real-time voice agents

09

Common mistakes

1 min read · Chapter 9 of 10

What usually goes wrong

SymptomLikely causeFirst thing to check
Callers say the agent is slowLong model response time, tool round trips, high reasoning effort, hops across cloudsMouth-to-ear time at the 95th percentile, by stage
The agent talks over callersSilence timer too short; slow speakers; callers reading digitsEnd-of-turn settings during data capture; keypad entry
The agent stops for no reasonBackchannels, coughs, a TV, its own voice echoingFalse-interruption rate; interruption classifier
Wrong names, emails or account numbers8 kHz audio, accents, noiseRead-back confirmation; spelling and keypad fallbacks
Calls end mid-conversation at 10 minutesPlatform maximum duration or a model connection limitMax-duration settings; session resumption
Outbound calls go unanswered"Spam Likely" labels, weak attestation, number reputationRegistration with analytics engines; your own signing token; SIP 603+ responses
A customer got two callsAn ambiguous timeout retried automaticallyDial logic and retry rules
The bill grows with call lengthSpeech-to-speech context replay; cache broken by mid-call changesCached share of input; static instructions and tools
A lawyer's letter about recordingThe vendor can train on audio; no notice naming itRetention and training settings; the greeting
A cloned voice gets throughVoiceprint as the only checkA second factor for money movement and account changes