Send and Receive Media Messages with WhatsApp in Java Servlets

Just like when sending an MMS, sending an outbound WhatsApp message uses Twilio's Message resource. This section walks you through the setting up and sending media in a WhatsApp message. Media can consist of images, audio files, and PDF documents.

Before you can send a WhatsApp message from your web language, you'll need to sign up for a Twilio account or sign into your existing account and activate the Twilio Sandbox for WhatsApp. The Sandbox allows you to prototype with WhatsApp immediately using a shared phone number without waiting for your Twilio number to be approved by WhatsApp.

To get started, select a number from the available sandbox numbers to activate your sandbox.

Expand image

Be sure to take note of the phone number you choose in the Sandbox. You will need this later when we're ready to send some messages.

Before you can send any messages, you'll need to gather your Twilio account credentials. You can find these in the Twilio Console.

• Account SID - Used to identify yourself in API requests
• Auth Token - Used to authenticate REST API requests

Expand image

For all of our code snippets and Java examples, you need to authenticate with the Account SID and Auth Token.

To send an outgoing media message via WhatsApp from your Twilio account you'll need to make an HTTP POST to Twilio's Message resource.

Sending a media message through WhatsApp is similar to sending a text-based message over WhatsApp with one important addition: the media_url parameter. The media_url parameter in this code tells Twilio where to retrieve the media that we want to include in the WhatsApp message. (You can prevent unauthorized access to your media by turning on HTTP Basic Auth for media URLs in the Twilio Console.)

Twilio's Node helper library helps you to create a new instance of the Message resource. When you do this, you'll specify the to, from, and mediaUrl parameters of your message.

If you don't already have the Java helper library installed you can add it to your POM dependencies by looking up the latest version here:

Now, create a file named app``.java and include the following code:

1
// Install the Java helper library from twilio.com/docs/java/install
2

3
import java.net.URI;
4
import com.twilio.type.PhoneNumber;
5
import java.util.Arrays;
6
import com.twilio.Twilio;
7
import com.twilio.rest.api.v2010.account.Message;
8

9
public class Example {
10
    // Find your Account SID and Auth Token at twilio.com/console
11
    // and set the environment variables. See http://twil.io/secure
12
    public static final String ACCOUNT_SID = System.getenv("TWILIO_ACCOUNT_SID");
13
    public static final String AUTH_TOKEN = System.getenv("TWILIO_AUTH_TOKEN");
14

15
    public static void main(String[] args) {
16
        Twilio.init(ACCOUNT_SID, AUTH_TOKEN);
17
        Message message =
18
            Message
19
                .creator(new com.twilio.type.PhoneNumber("whatsapp:+14155238886"),
20
                    new com.twilio.type.PhoneNumber("whatsapp:+15017122661"),
21
                    Arrays.asList(URI.create(
22
                        "https://images.unsplash.com/photo-1545093149-618ce3bcf49d?ixlib=rb-1.2.1&ixid=eyJhcHBfaWQiOjEyMDd9&auto=format&fit=crop&w=668&q=80")))
23
                .create();
24

25
        System.out.println(message.getSid());
26
    }
27
}

1
{
2
  "account_sid": "ACaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
3
  "api_version": "2010-04-01",
4
  "body": "Hello! 👍",
5
  "date_created": "Thu, 24 Aug 2023 05:01:45 +0000",
6
  "date_sent": "Thu, 24 Aug 2023 05:01:45 +0000",
7
  "date_updated": "Thu, 24 Aug 2023 05:01:45 +0000",
8
  "direction": "outbound-api",
9
  "error_code": null,
10
  "error_message": null,
11
  "from": "whatsapp:+15017122661",
12
  "num_media": "0",
13
  "num_segments": "1",
14
  "price": null,
15
  "price_unit": null,
16
  "messaging_service_sid": "MGaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
17
  "sid": "SMaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa",
18
  "status": "queued",
19
  "subresource_uris": {
20
    "media": "/2010-04-01/Accounts/ACaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/Messages/SMaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/Media.json"
21
  },
22
  "tags": {
23
    "campaign_name": "Spring Sale 2022",
24
    "message_type": "cart_abandoned"
25
  },
26
  "to": "whatsapp:+14155238886",
27
  "uri": "/2010-04-01/Accounts/ACaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/Messages/SMaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa.json"
28
}

Replace the placeholder values for accountSid and authToken with your unique values. You can find these in your Twilio console.

The to number should be the phone number for the destination WhatsApp account in the E.164 format. If you are using the WhatsApp Sandbox, you can only send messages to numbers that have joined the Sandbox.

You'll tell Twilio which phone number to use to send this message by replacing the from number with the whatsapp: channel identifier followed by the Sandbox number in E.164 format.

Save the file and run it:

mvn compile exec:java -Dexec.mainClass=com.twilio.app.App

In a few moments, you should receive a WhatsApp message with an image!

When you send an outbound WhatsApp media message, Twilio sends data about the message in its response to your request. The JSON response contains the unique SID and URI for your media resource:

"subresource_uris": {"media": "/2010-04 01/Accounts/ACxxxxxxxx/Messages/SMxxxxxxxxxxxxx/Media.json"}

When the Twilio REST API creates your new Message resource, it saves the image found at the specified mediaUrl as a Media resource. Once created, you can access this resource at any time via the API.

You can print this value from your C# code to see where the image is stored. The following line to the end of your program.cs file prints out your newly provisioned Media URI:

System.out.println(message.subresourceUris.get("media");

To reply using media to incoming WhatsApp messages, you'll need to provide Twilio with a webhook URL that points to a server that runs code to inspect and save the media files.

Webhooks are user-defined HTTP callbacks. They are usually triggered by some event, such as receiving an SMS message or an incoming phone call. When that event occurs, Twilio makes an HTTP request (usually a POST or a GET) to the URL configured for the webhook.

To handle a webhook, you only need to build a small web application that can accept the HTTP requests. Almost all server-side programming languages offer some framework for you to do this. In this tutorial, we'll be setting up our web application with Servlets.

Webhook functionality is the same for every Twilio application. First, a webhook makes an HTTP request to a URI that you provide to Twilio. When it receives this request, your application performs pre-defined logic. This could be something like database read/writes or calling another API. Finally, your application sends a TwiML response to Twilio in which it specifies the instructions for Twilio to follow.

TwiML is the Twilio Markup Language, which is just to say that it's an XML document with special tags defined by Twilio to help you build your messaging and voice applications.

TwiML is easier shown than explained:

1
<?xml version="1.0" encoding="UTF-8"?>
2
<Response>
3
   <Message>Thanks for the message!</Message>
4
</Response>

Every TwiML document has the <Response> element, which can contain one or more verbs. Verbs are actions you'd like Twilio to take, such as <Say> a greeting to a caller, or send an SMS <Message> in reply to an incoming message. For a full reference on everything you can do with TwiML, refer to our TwiML API Reference.

To send back a media in your WhatsApp reply, you need to include the media TwiML element with the URL to the media file. One media attachment is supported per message, with a size limit of 5MB.

To reply to an incoming WhatsApp message, you can either write raw TwiML or use a helper library. When you use the helper library, you don't have to worry about generating the raw XML yourself.

1
package com.twilio.whatsapp_media.servlet;
2

3
import java.io.IOException;
4
import java.io.PrintWriter;
5

6
import javax.servlet.annotation.WebServlet;
7
import javax.servlet.http.HttpServlet;
8
import javax.servlet.http.HttpServletRequest;
9
import javax.servlet.http.HttpServletResponse;
10

11
import com.twilio.twiml.MessagingResponse;
12
import com.twilio.twiml.messaging.Body;
13
import com.twilio.twiml.messaging.Media;
14
import com.twilio.twiml.messaging.Message;
15

16
@WebServlet(urlPatterns = { "/" })
17
public class WhatsappMediaWebhook extends HttpServlet {
18
    private static final String GOOD_BOY_URL = "https://images.unsplash.com/photo-1518717758536-85ae29035b6d?ixlib=rb-1.2.1&ixid=eyJhcHBfaWQiOjEyMDd9&auto=format&fit=crop&w=1350&q=80";
19

20
    @Override
21
    protected void doPost(HttpServletRequest request, HttpServletResponse response)
22
            throws IOException {
23
        var numMedia = Integer.parseInt(request.getParameter("NumMedia"));
24
        var twimlResponse = new MessagingResponse.Builder();
25
        if (numMedia > 0) {
26
            twimlResponse.message(
27
                    new Message.Builder().body(new Body.Builder("Thanks for the image! Here's one for you!").build())
28
                            .media(new Media.Builder(GOOD_BOY_URL).build()).build());
29
        } else {
30
            twimlResponse.message(new Message.Builder().body(new Body.Builder("Send us an image!").build()).build());
31
        }
32

33
        response.setContentType("text/xml");
34
        response.setCharacterEncoding("UTF-8");
35
        PrintWriter out = response.getWriter();
36
        out.write(twimlResponse.build().toXml());
37

38
        out.flush();
39
        out.close();
40
    }
41

42
}

You have the code - now you need a URL you can give to Twilio.

Twilio can only access public servers on the Internet. That means you need to take your web application and publish it to a web or cloud hosting provider (of which there are many), you can host it on your own server, or you can use a service such as ngrok to expose your local development machine to the internet. (We only recommend the latter for development and testing purposes and not for production deployments.)

To send media in response to an incoming WhatsApp message, add an image URL. If necessary, restart your server, then send a message to your WhatsApp number again. You should receive a WhatsApp message that includes an image. Check out the API Reference for more details.

Now that you have a URL for your web application's TwiML reply generating routine, you can configure your Twilio phone number to call your webhook URL whenever a new WhatsApp message comes in for you.

You can set the webhook URL for incoming messages to your server in the Sandbox.

Make sure you choose HTTP POST or HTTP GET to correspond to what your web application is expecting. Usually, the default of POST is fine.

Viewing, saving, or manipulating the media files on incoming WhatsApp messages also involves configuring a Webhook URL. The URL points to a server generating TwiML instructions including the media you want to send.

When Twilio calls your webhook, it sends a number of parameters about the message you just received. Most of these, such as the To phone number, the From phone number, and the Body of the message are available as properties of the request parameter to our action method.

Twilio sends form variables named MediaUrlX, where X is a zero-based index. WhatsApp messages will only contain one media file per incoming message, so you can access the file at MediaUrl0 on the incoming request from Twilio to your webhook URL.

Attachments to WhatsApp messages can be of many different file types, including JPG, MP3, and PDF. (See more about the supported file types in the FAQs.) Twilio handles the determination of the file type for you and you can get the standard mime type from the MediaContentTypeX parameter. If you are expecting photos and images, then you will likely see a lot of attachments with the mime type image/jpeg.

And that's all there is to it; receiving and responding is exactly the same as you would do in any SMS app with our Messaging API. Cool, right?

All the code, in a complete working project, is available on GitHub. To dig deeper, head over to the Messaging API Reference and learn more about the Twilio webhook request and the REST API Media resource. Also, you should be aware of the pricing for storage of all the media files that you keep on Twilio's servers.

We'd love to hear what you build with this!