Twilio Conversation Relay

Human-friendly voice AI that keeps customers from shouting "live agent!"

Easily integrate voice AI into your stack for smooth, personalized customer conversations — no complicated infrastructure or awkward AI moments.

Smiling woman speaking on the phone with a virtual agent interface overlay displayed.
Smiling woman speaking on the phone with a virtual agent interface overlay displayed.

Demo voice AI with Conversation Relay

Conversation Relay takes voice AI from POC to production

Diagram showing integration of Twilio Voice with a ConversationRelay API connecting to an app with TTS and STT components.
Diagram showing integration of Twilio Voice with a ConversationRelay API connecting to an app with TTS and STT components.

Conversation Relay connects AI agents to Twilio’s real-time voice AI infrastructure. You bring your preferred LLMs, speech providers, and agent runtime. Twilio manages the voice layer underneath, including turn-taking, expressive voices, resilient transcription, and conversation context at scale.

  • Keep conversations flowing with smarter turn detection

    Use semantic turn detection and interruption controls to reduce awkward pauses, premature responses, and agents cutting callers off mid-thought.

  • Deliver natural, expressive voices

    Deploy human-like voice AI experiences with low-latency conversational TTS, expanded voice options, and support for multilingual conversations.

  • Connect context to every conversation

    Use customer profile data and conversation history to help your AI agent personalize live interactions. Each conversation enriches the customer record, creating more context for future interactions.

Built for live conversation

Optimized for latency to keep dialog flowing at a natural pace.

<0.5 S

median latency

<0.725 S

at the 95th percentile*

Build AI support that understands your customers

Create customer experiences that are engaging, friendly, and always on point.

Deliver effortless self-service support

Enable context-aware, intelligent virtual agents that handle inquiries
efficiently—and know exactly when to bring in a human.

  • Handle routine inquiries while keeping customers engaged and frustration-free. 

  • Escalate complex or sensitive issues to live agents when needed.

  • Orchestrate customer data to provide personalized, context-rich interactions at scale.

Flowchart showing an incoming call, user data collection, virtual agent interaction, and sentiment analysis.
Flowchart showing an incoming call, user data collection, virtual agent interaction, and sentiment analysis.

Conversation Relay features

Focus on building AI agents that solve real problems. Twilio provides the voice infrastructure at scale.

A dashboard showing a virtual agent and sentiment analysis results indicating positive sentiment.
A dashboard showing a virtual agent and sentiment analysis results indicating positive sentiment.

New

Turn every interaction into a continuous, contextual conversation

Conversation Relay is part of the Conversations layer of the Twilio platform. You can turn fragmented customer interactions into a continuous conversation that moves across channels, AI agents and human agents and time without losing any context. In fact, it gets smarter with every interaction through a persistent customer memory.

  • LLM integration that works for you

    Get the flexibility to bring your own LLM so you can control your UX, manage costs, and adopt new tech as it's released.

  • Speech recognition and resilient transcription

    Convert speech to text across languages, in real time, with automated failover across providers in case of outages, delays, or latency.

  • Natural, multilingual text-to-speech

    Deliver more human-like voice experiences with expressive conversational TTS, which come with expanded voice options and support for multilingual conversations.

  • Semantic turn detection and interruption handling

    Use semantics-aware turn detection, barge-in, and configurable interruption handling so agents respond without cutting callers off.

  • Flexible speech and agent integrations

    Bring your preferred speech-to-text, text-to-speech, and agent environments to Conversation Relay while Twilio handles the real-time voice layer.

  • Low-latency infrastructure

    Minimize latency to improve the quality of voice AI interactions and ensure a better customer experience.

  • Scale securely in highly regulated industries

    Build PCI-compliant workflows and HIPAA-eligible architectures to deploy compliant solutions faster.

  • Transcription and conversation visibility

    Capture transcripts from live and recorded conversations, then connect them to Conversation Intelligence to analyze, supervise, and improve customer interactions.

Start bringing your voice AI agent to life

Explore our comprehensive APIs, documentation, and the Conversation Relay Studio Widget, which allows teams to deploy secure AI voice flows using drag-and-drop tools.

<?xml version="1.0" encoding="UTF-8"?>

<Response>
  <Connect action="https://myhttpserver.com/connect_action">
    <ConversationRelay url="wss://mywebsocketserver.com/websocket" welcomeGreeting="Hi! Ask me anything!" />
  </Connect>
</Response>

Need help setting up Conversation Relay?

Work with one of our trusted partners to set up your voice AI solution and start delivering amazing engagement. View partners

Your AI powers the conversations. We handle the voice.

Deploy secure voice AI flows using our intuitive drag-and-drop Studio Widget or comprehensive APIs, so you can focus on designing the smart, meaningful interactions your virtual agents need to deliver.

A smiling man holding a phone to his ear, wearing a dark jacket and green shirt with a red background.
A smiling man holding a phone to his ear, wearing a dark jacket and green shirt with a red background.

Conversation Relay FAQs

Twilio Conversation Relay integrates voice AI into your stack for natural, human-sounding phone conversations. It combines fast speech-to-text and text-to-speech with the LLM of your choice, orchestrated through a WebSocket API. This lets you build smooth, personalized voice agents without wiring up complex infrastructure or living with awkward AI pauses.

In a voice conversation, the delays are what make AI agents feel robotic. Twilio Conversation Relay is built to sound natural with median latency under 0.5 seconds and under 0.725 seconds at the 95th percentile, per internal benchmarks. Deepgram Flux, automatic language detection, and SSML tags cut the awkward pauses, so dialog flows at a human pace.

Conversation Relay helps AI agents know when to listen, when to respond, and when a caller is still mid-thought. With smart turn detection, barge-in support, and configurable interruption handling, teams can reduce awkward cutoffs and premature AI responses.

This helps conversations feel more natural — even when callers pause, hesitate, interrupt, or speak in noisy environments.

Yes. Twilio Conversation Relay is built for bring-your-own-LLM, so you control the UX, the costs, and can adopt new models as they ship. You get natural human-sounding TTS and real-time STT out of the box. Or, you can bring your own text-to-speech for a fully custom voice.

Twilio Conversation Relay supports HIPAA-eligible architectures and PCI-compliant workflows to help you deploy voice AI in regulated industries like healthcare and finance. 

Twilio Conversation Relay is built for fast deployment. Use the drag-and-drop Studio Widget to build secure voice AI flows without heavy code, or go deeper with the WebSocket API and docs. You bring the AI and design the conversation, and Twilio handles the voice infrastructure underneath.

Conversation Relay supports multilingual voice AI experiences by connecting live calls to your preferred speech recognition, text-to-speech, and LLM providers. With automatic language detection and expanded language support, teams can build agents that recognize the language a caller is speaking and adapt the conversation experience in real time.

Conversation Relay provides the real-time voice infrastructure, while giving teams flexibility to choose the AI and speech providers that best support their language and regional needs.

*Based on internal benchmarks with Conversation Relay (p50 491 ms, p95 713 ms) using different models. Results may vary.

Let's find the right products for you

Generating your product picks...

See your product picks