ConversationRelay now supports a configuration for automatic language detection

When using Deepgram as the transcription provider, if you want Twilio to detect the language spoken by the user, you can specify multi as the active speech-to-text (STT) language for the session. When Twilio sends a prompt message to your application, the lang will include the language detected by Deepgram. When using multi, lang will only include the primary language tag in the BCP-47, for example "lang"="en" not "lang"="en-US".

When using Elevenlabs as text-to-speech (TTS) provider, if you want Twilio to detect the language sent in the text token message from your app for text-to-speech (TTS), you can specify multi as the active TTS language for the session. If you specify multi as the lang in the text token message to Twilio, ElevenLabs will detect the language from the token and use that language for TTS.

For more information, please refer to the docs:

• <ConversationRelay> TwiML noun: Automatic language detection | Twilio
• Getting and sending WebSocket messages | Twilio