Skip to contentSkip to navigationSkip to topbar
Rate this page:
On this page

Getting Started: JavaScript


(warning)

Warning

This page is for reference only. We are no longer onboarding new customers to Programmable Video. Existing customers can continue to use the product until December 5, 2024(link takes you to an external page).
We recommend migrating your application to the API provided by our preferred video partner, Zoom. We've prepared this migration guide(link takes you to an external page) to assist you in minimizing any service disruption.


Contents

contents page anchor

This guide provides you with an overview of the key objects you'll use in the Programmable Video API to build your video application with the Twilio Programmable Video JavaScript SDK.

Note: If you haven't already done so, take a look at the open source video collaboration app(link takes you to an external page) and quickstart apps(link takes you to an external page). Then come back to this guide for more detail on how to add video to your own app.

If you've worked with WebRTC in the past, you'll find that Programmable Video provides a simple wrapper around WebRTC's lower-level APIs to make it easy to build rich audio and video applications. You can still access lower-level primitives, but that's not required to get started.

Additionally, Programmable Video provides the missing pieces required to use WebRTC to build sophisticated applications: Global STUN/TURN relays, media services for large-scale group conferences and recording, and signaling infrastructure are all included.


Let's start with an overview of the Programmable Video API:

  • A Room represents a real-time audio, data, video, and/or screen-share session, and is the basic building block for a Programmable Video application.
  • In a Peer-to-peer Room , media flows directly between participants. Supports up to 10 participants in a mesh topology.
  • In a Group Room , media is routed through Twilio's Media Servers. Supports up to 50 participants.
  • Participants represent client applications that are connected to a Room and sharing audio, data, and/or video media with one another.
  • Tracks represent the individual audio, data, and video media streams that are shared within a Room.
  • LocalTracks represent the audio, data, and video captured from the local client's media sources (for example, microphone and camera).
  • RemoteTracks represent the audio, data, and video tracks from other participants connected to the Room.

The following code samples illustrate common tasks that you as a developer may wish to perform related to a Room and its Participants.


To start using the JavaScript Programmable Video SDK in your apps, you need to perform a few basic tasks first.

1. Get the Programmable Video JavaScript SDK

1-get-the-programmable-video-javascript-sdk page anchor

You can install the JavaScript Video library using NPM(link takes you to an external page).

NPM

npm page anchor

_10
npm install twilio-video --save

You can also include it in your application using our CDN.

Releases of twilio-video.js are hosted on a CDN, and you can include these directly in your web app using a <script> tag.


_10
<script src="//sdk.twilio.com/js/video/releases/2.17.1/twilio-video.min.js"></script>

Using this method, twilio-video.js will set a browser global:


_10
const Video = Twilio.Video;

Please refer to this table for information regarding supported browsers and operating systems.

API Keys represent credentials to access the Twilio API. They are used for two purposes:

For the purposes of this guide, we will create our API Key from the Twilio Console.

  • Go to the API Keys section(link takes you to an external page) under Account in the Twilio Console
  • Click on "Create a New API Key"
    • Add a friendly name
    • Select "United States (US1)" for the region. Keys created outside the US1 region will not work.
    • Choose "Standard" for the key type
  • Save your Key and Secret. You will only be able to see the secret in the Console once.

3. Generate an Access Token

3-generate-an-access-token page anchor

To execute the code samples below, you'll need to generate an Access Token. An Access Token is a short-lived credential used to authenticate your client-side application to Twilio.

You can generate an Access Token using either the Twilio CLI or a Twilio helper library. For application testing purposes, the Twilio CLI provides a quick way to generate Access Tokens that you can then copy/paste into your application.

To use the CLI, you will need to install the Twilio CLI and log in to your Twilio account from the command line; see the CLI Quickstart for instructions. Then, you can install the Token CLI plugin(link takes you to an external page) with the following command:


_10
twilio plugins:install @twilio-labs/plugin-token

To generate an Access Token, run the following command. --identity is a required argument and should be a string that represents the user identity for this Access Token.


_10
twilio token:video --identity=<identity>

In a production application, your back-end server will need to generate an Access Token for every user in your application. Visit the User Identity and Access Token guide to learn more. You can find examples of how to generate an Access Token for a participant using Twilio's helper libraries in the User Identity and Acces Token guide.


Call connect to connect to a Room from your web application. Once connected, you can send and receive audio and video streams with other Participants who are connected to the Room.


_10
const { connect } = require('twilio-video');
_10
_10
connect('$TOKEN', { name:'my-new-room' }).then(room => {
_10
console.log(`Successfully joined a Room: ${room}`);
_10
room.on('participantConnected', participant => {
_10
console.log(`A remote Participant connected: ${participant}`);
_10
});
_10
}, error => {
_10
console.error(`Unable to connect to Room: ${error.message}`);
_10
});

You must pass the Access Token when connecting to a Room. You may also optionally pass the following:

  • Audio and video options , which when enabled will create and publish audio and video tracks from your local camera and microphone to the Room immediately upon connecting.
  • Local audio, data, and/or video tracks , to begin sharing pre-created local media and data with other Participants in the Room upon connecting.
  • A Room name , which allows you to dynamically specify the name of the Room you wish to join. (Note: You can also encode the Room name in the Access Token, which will allow the user to connect to only the Room specified in the token.)
  • A log level for debugging.

The name of the Room specifies which Room you wish to join. If client-side Room creation is enabled, and if a Room by that name does not already exist, it will be created upon connection. If a Room by that name is already active, you'll be connected to the Room and receive notifications from any other Participants also connected to the same Room. Room names must be unique within an account.

You can also create a Room using the Rooms REST API. Look at the REST API Rooms resource docs for more details.

Example: Create a Room called "DailyStandup"

example-create-a-room-called-dailystandup page anchor

_10
curl -XPOST 'https://video.twilio.com/v1/Rooms' \
_10
-u '{API Key SID}:{API Secret}' \
_10
-d 'UniqueName=DailyStandup'

Note: If you don't specify a Type attribute, then Twilio will create a Room based on the default Type in the Room Settings.

You can also set the Room Type from the Room Settings(link takes you to an external page) page in the Twilio Video Console. Twilio will use the Room Type set on Room Settings page, when you create a Room from the client-side or the REST API.

Note: Twilio will set the Room Type as "Group" by default on the Room Settings page.

Once a Room is created, Twilio will fire a Room-created webhook event, if the StatusCallback URL is set. You can set the StatusCallback URL on the Room Settings(link takes you to an external page) page, if you want create a Room from the client-side. If you create a Room using the REST API, then you need to provide a StatusCallback URL while creating the Room.


_10
curl -XPOST 'https://video.twilio.com/v1/Rooms' \
_10
-u '{API Key SID}:{API Secret}' \
_10
-d 'UniqueName=DailyStandup' \
_10
-d 'StatusCallback=https://hooks.yoursite.com/room-events' \
_10
-d 'StatusCallbackMethod=POST' \
_10
-d 'Type=group'

Enabling Room Recordings

enabling-room-recordings page anchor

Recordings can be enabled only on Group Rooms. Set Recordings to Enabled to record Participants when they connect to a Group Room. Recordings can also be enabled on Group Rooms through via the Rest API at Room creation time by setting the RecordParticipantsOnConnect property to true.


_10
curl -XPOST 'https://video.twilio.com/v1/Rooms' \
_10
-u 'SKXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX:your_api_key_secret' \
_10
-d 'UniqueName=DailyStandup' \
_10
-d 'Type=group' \
_10
-d 'RecordParticipantsOnConnect=true' \
_10
-d 'StatusCallback=http://example.org'


If you'd like to join a Room you know already exists, you handle that exactly the same way as creating a Room: just pass the Room name to the connect method. Once in a Room, you'll receive a "participantConnected" event for each Participant that successfully joins. Querying the participants getter will return any existing Participants who have already joined the Room.


_10
const { connect } = require('twilio-video');
_10
_10
connect('$TOKEN', { name: 'existing-room' }).then(room => {
_10
console.log(`Successfully joined a Room: ${room}`);
_10
room.on('participantConnected', participant => {
_10
console.log(`A remote Participant connected: ${participant}`);
_10
});
_10
}, error => {
_10
console.error(`Unable to connect to Room: ${error.message}`);
_10
});


You can capture local media from your device's microphone, camera or screen-share on different platforms in the following ways:


_23
const { connect, createLocalTracks } = require('twilio-video');
_23
_23
// Option 1
_23
createLocalTracks({
_23
audio: true,
_23
video: { width: 640 }
_23
}).then(localTracks => {
_23
return connect('$TOKEN', {
_23
name: 'my-room-name',
_23
tracks: localTracks
_23
});
_23
}).then(room => {
_23
console.log(`Connected to Room: ${room.name}`);
_23
});
_23
_23
// Option 2
_23
connect('$TOKEN', {
_23
audio: true,
_23
name: 'my-room-name',
_23
video: { width: 640 }
_23
}).then(room => {
_23
console.log(`Connected to Room: ${room.name}`);
_23
});

NOTE: Tracks that are published through ConnectOptions will not emit "trackPublished" events for other Participants in the Room.

Use Twilio's createLocalTracks(link takes you to an external page) API to gain access to the user's microphone and camera. Note that some browsers, such as Google Chrome, will only let your application access local media when your site is served from localhost or over HTTPS.


Working with Remote Participants

working-with-remote-participants page anchor

Handle Connected Participants

handle-connected-participants page anchor

When you join a Room, Participants may already be present. You can check for existing Participants by using the Room's participants collection:


_18
// Log your Client's LocalParticipant in the Room
_18
const localParticipant = room.localParticipant;
_18
console.log(`Connected to the Room as LocalParticipant "${localParticipant.identity}"`);
_18
_18
// Log any Participants already connected to the Room
_18
room.participants.forEach(participant => {
_18
console.log(`Participant "${participant.identity}" is connected to the Room`);
_18
});
_18
_18
// Log new Participants as they connect to the Room
_18
room.once('participantConnected', participant => {
_18
console.log(`Participant "${participant.identity}" has connected to the Room`);
_18
});
_18
_18
// Log Participants as they disconnect from the Room
_18
room.once('participantDisconnected', participant => {
_18
console.log(`Participant "${participant.identity}" has disconnected from the Room`);
_18
});

Handle Participant Connection Events

handle-participant-connection-events page anchor

When Participants connect to or disconnect from a Room that you're connected to, you'll be notified via Participant connection events:


_10
room.on('participantConnected', participant => {
_10
console.log(`Participant connected: ${participant.identity}`);
_10
});
_10
_10
room.on('participantDisconnected', participant => {
_10
console.log(`Participant disconnected: ${participant.identity}`);
_10
});

Display a Remote Participant's Video

display-a-remote-participants-video page anchor

To see the Video Tracks being sent by remote Participants, we need to render them to the screen. Because Participants can publish Tracks at any time, we'll want to handle both

  • the Tracks that the Participant has already published, and
  • the Tracks that the Participant eventually publishes.

We can handle the former by iterating over tracks and we can handle the latter by attaching an event listener for "trackSubscribed":


_15
// Attach the Participant's Media to a <div> element.
_15
room.on('participantConnected', participant => {
_15
console.log(`Participant "${participant.identity}" connected`);
_15
_15
participant.tracks.forEach(publication => {
_15
if (publication.isSubscribed) {
_15
const track = publication.track;
_15
document.getElementById('remote-media-div').appendChild(track.attach());
_15
}
_15
});
_15
_15
participant.on('trackSubscribed', track => {
_15
document.getElementById('remote-media-div').appendChild(track.attach());
_15
});
_15
});

For RemoteParticipants that are already in the Room, we can attach their RemoteTracks by iterating over the Room's participants:


_11
room.participants.forEach(participant => {
_11
participant.tracks.forEach(publication => {
_11
if (publication.track) {
_11
document.getElementById('remote-media-div').appendChild(publication.track.attach());
_11
}
_11
});
_11
_11
participant.on('trackSubscribed', track => {
_11
document.getElementById('remote-media-div').appendChild(track.attach());
_11
});
_11
});


Mute and Unmute Audio and Video

mute-and-unmute-audio-and-video page anchor

You can mute your LocalAudioTracks (microphone) and LocalVideoTracks (camera) by calling the disable method as shown below:


_10
room.localParticipant.audioTracks.forEach(publication => {
_10
publication.track.disable();
_10
});
_10
_10
room.localParticipant.videoTracks.forEach(publication => {
_10
publication.track.disable();
_10
});

NOTE: Although disabling a LocalVideoTrack whose source is a camera stops sending media, the camera is still reserved by the LocalVideoTrack and hence its light still stays on. In some use cases, the desired behavior might be that the light should turn off when users mutes their camera. Although this method is not recommend, this can be achieved by calling stop on the LocalVideoTrack and unpublishing it from the Room:


_10
room.localParticipant.videoTracks.forEach(publication => {
_10
publication.track.stop();
_10
publication.unpublish();
_10
});

Handle Remote Media Mute Events

handle-remote-media-mute-events page anchor

When RemoteParticipants mute their media, you will be notified through a "disabled" event on the corresponding RemoteAudioTrack and/or RemoteVideoTrack. You can listen to this event as shown below:


_14
function handleTrackDisabled(track) {
_14
track.on('disabled', () => {
_14
/* Hide the associated <video> element and show an avatar image. */
_14
});
_14
}
_14
_14
room.participants.forEach(participant => {
_14
participant.tracks.forEach(publication => {
_14
if (publication.isSubscribed) {
_14
handleTrackDisabled(publication.track);
_14
}
_14
publication.on('subscribed', handleTrackDisabled);
_14
});
_14
});

NOTE: If RemoteParticipants mute their video by unpublishing their LocalVideoTracks, then you can listen to the "unsubscribed" event on the RemoteTrackPublication instead:


_10
room.participants.forEach(participant => {
_10
participant.tracks.forEach(publication => {
_10
publication.on('unsubscribed', () => {
_10
/* Hide the associated <video> element and show an avatar image. */
_10
});
_10
});
_10
});

You can unmute your LocalAudioTracks and LocalVideoTracks by calling the enable method as shown below:


_10
room.localParticipant.audioTracks.forEach(publication => {
_10
publication.track.enable();
_10
});
_10
_10
room.localParticipant.videoTracks.forEach(publication => {
_10
publication.track.enable();
_10
});

NOTE: If you muted your camera by stopping and unpublishing the associated LocalVideoTrack, then you can unmute your local video by creating a new LocalVideoTrack and publishing it to the Room:


_10
const { createLocalVideoTrack } = require('twilio-video');
_10
_10
createLocalVideoTrack().then(localVideoTrack => {
_10
return room.localParticipant.publishTrack(localVideoTrack);
_10
}).then(publication => {
_10
console.log('Successfully unmuted your video:', publication);
_10
});

Handle Remote Media Unmute Events

handle-remote-media-unmute-events page anchor

When RemoteParticipants unmute their media, you will be notified through an "enabled" event on the corresponding RemoteAudioTrack and/or RemoteVideoTrack. You can listen to this event as shown below:


_14
function handleTrackEnabled(track) {
_14
track.on('enabled', () => {
_14
/* Hide the avatar image and show the associated <video> element. */
_14
});
_14
}
_14
_14
room.participants.forEach(participant => {
_14
participant.tracks.forEach(publication => {
_14
if (publication.isSubscribed) {
_14
handleTrackEnabled(publication.track);
_14
}
_14
publication.on('subscribed', handleTrackEnabled);
_14
});
_14
});

NOTE: If RemoteParticipants unmute their video by publishing new LocalVideoTracks, then you can listen to the "subscribed" event on the RemoteTrackPublication instead:


_10
room.participants.forEach(participant => {
_10
participant.tracks.forEach(publication => {
_10
publication.on('subscribed', () => {
_10
/* Hide the avatar image and show the associated <video> element. */
_10
});
_10
});
_10
});


Display a Camera Preview

display-a-camera-preview page anchor

Sometimes you need to make sure you're looking fantastic before entering a Room. We get it. Each SDK provides a means to render a local camera preview outside the context of an active Room:


_10
const { createLocalVideoTrack } = require('twilio-video');
_10
_10
createLocalVideoTrack().then(track => {
_10
const localMediaContainer = document.getElementById('local-media');
_10
localMediaContainer.appendChild(track.attach());
_10
});

You can disconnect from a Room you're currently participating in. Other Participants will receive a "participantDisconnected" event:


_10
room.on('disconnected', room => {
_10
// Detach the local media elements
_10
room.localParticipant.tracks.forEach(publication => {
_10
const attachedElements = publication.track.detach();
_10
attachedElements.forEach(element => element.remove());
_10
});
_10
});
_10
_10
// To disconnect from a Room
_10
room.disconnect();


The Programmable Video REST API allows you to control your video applications from your back-end server via HTTP requests.


Rate this page: