Turn-taking

Turn-taking is the timing system that decides when the user is speaking, when the avatar should listen, and when the avatar should respond, so the conversation feels natural rather than rushed or delayed.

How turn-taking works

Turn-taking is the timing layer that makes an avatar conversation feel like a live exchange instead of alternating recordings. It decides when the user has started speaking, paused, interrupted, or finished a thought.

The system usually combines voice activity detection, partial ASR, conversation state, and response timing rules. It has to avoid cutting users off too early while also avoiding long silences that make the avatar feel slow.

A concrete example: a user pauses halfway through a question to think. Good turn-taking waits for the rest of the sentence. If the user starts speaking while the avatar talks, barge-in lets the system stop and listen.

Turn-taking is one of the small details users feel immediately. Even with a strong model and realistic face, poor timing makes the whole experience feel awkward.

Diagram explaining how the Anam Engine is used for AI developers

Diagram of how Anam works

What Anam ships

Anam's Cara-4 model delivers expressive real-time avatars with around 150 ms server-side avatar-generation latency once a session is running, across 70+ languages. Builders use JavaScript and Python SDKs or integrations for LiveKit, Pipecat, ElevenLabs Agents, Agora, and VideoSDK. Bring any AI stack including OpenAI, Claude, Gemini, Mistral, Groq, Deepgram, Cartesia, or custom providers. The platform supports WebRTC delivery, SOC 2 Type II, HIPAA, zero data retention, and regional data residency. Sessions stream low-latency audio and video to browsers and native apps.

Explore the real-time avatar API →

Related terms

Barge-in

Barge-in is the ability for a user to interrupt an avatar while it is speaking, so the system can stop the current response, listen to the new input, and continue the conversation naturally.

VAD (voice activity detection)

VAD, or voice activity detection, is the process of detecting when a user is speaking or silent, helping an avatar manage turn-taking, barge-in, and response timing during a live session.

ASR (speech recognition)

ASR, or automatic speech recognition, is the system that converts live spoken audio into text so an avatar or agent can understand the user and decide what to do next.

AI voice agent

An AI voice agent is a speech-first conversational agent that uses speech recognition, an LLM or agent workflow, and text-to-speech to understand spoken input and reply naturally in real time.

Frequently asked questions

What is turn-taking in an avatar conversation?

Turn-taking is the logic that decides when the user is speaking, when the avatar should wait, and when the avatar should respond during a live exchange.

Why does turn-taking matter for real-time avatars?

People are sensitive to timing in conversation. If the avatar interrupts, waits too long, or talks over the user, the interaction stops feeling natural.

How is turn-taking different from ASR?

ASR converts speech into text. Turn-taking decides what that speech activity means for the flow of the conversation, including pauses, interruptions, and when to answer.

What makes turn-taking difficult?

Background noise, long pauses, overlapping speech, short acknowledgements, and network delay can all make it hard to know whether the user is finished or still speaking.

Last updated: 17th July 2026 · Reviewed quarterly.

← Back to glossary

Try the real-time avatar API trusted by 8,000 builders

Read the docs

HIPAA & SOC 2 Certified