Definition
An AI voice agent is a system that holds spoken conversations, typically on phone lines, using speech recognition, a language model and speech synthesis, and can complete tasks in back-end systems.
Components
- Speech recognition turns speech into text.
- A language model, often with retrieval, decides what to say and do.
- Speech synthesis replies in a natural voice.
On-premise voice
Running all three on your own infrastructure keeps recordings and transcripts inside, and small fine-tuned models help keep replies fast.
See voice agents.