Connecting Voice Calls to an Amazon Lex Bot
Published on March 10, 2021

Today’s AI platforms offer advanced capabilities with voice and text bots, transcription engines, and sentiment analysis engines.

These capabilities help developers build bots that serve a multitude of functions, including supporting callers in placing orders, making a booking, getting assistance with issues, and much more.

In this tutorial, we will guide you on setting up a basic Amazon Lex bot, setting up a Lex reference connection, and a sample Vonage Voice API application, which will allow you to call a phone number and interact with the Lex bot via voice.

In the first section, we will set up an example Amazon Lex bot.

Next, we will set up a Lex reference connection. This Lex reference connection allows 2-way audio streaming of the caller’s voice and Lex bot responses via WebSockets. It also relays the transcriptions and sentiment scores from Lex bot to the Voice API application.

After that, we will set up a sample application using Vonage Voice API to handle an incoming call, establish the WebSocket, receive the caller and bot transcriptions, and the sentiment analysis scores of a caller’s sentences.

The diagram below shows an overview of this sample integration architecture.

A diagram that outlines how Amazon Lex and the Vonage Voice API work together to create a voice botA diagram that outlines how Amazon Lex and the Vonage Voice API work together to create a voice bot

Prerequisites

To perform the actions outlined in the following steps, you will need an Amazon Web Services account. If you don't have one, you can create one before getting started.

DT API Account

To complete this tutorial, you will need a DT API account. If you don’t have one already, you can sign up today and start building with free credit. Once you have an account, you can find your API Key and API Secret at the top of the DT API Dashboard.

This tutorial also uses a virtual phone number. To purchase one, go to Numbers > Buy Numbers and search for one that meets your needs.

Set up an Example Amazon Lex Bot

Log in to your AWS Management Console or create an AWS account if you do not yet have one.

Search for and then go to Amazon Lex service, click on Create to launch the bot setup process.

The Amazon Lex service dashboardThe Amazon Lex service dashboard

As part of the setup process, you will be presented with the option to Create Your Own bot or to Try a Sample. You'll need a sample bot for this example, so click on ScheduleAppointment.

The Amazon Lex Bot Creation DashboardThe Amazon Lex Bot Creation Dashboard

Next, you can set up the bot.

  • You may keep the pre-set bot name or enter a different one

  • make a note of the bot name (e.g. ScheduleAppointment), you will need it later

The Lex bot setup screen from Amazon Web ServicesThe Lex bot setup screen from Amazon Web Services

  • Select the desired language

  • Select Yes for Sentiment Analysis

  • For this specific bot example, you may select No for COPPA

Once the settings are completed, click on Create.

Final steps in the bot setup processFinal steps in the bot setup process

When the bot creation process has completed, you will see a screen similar to the one shown below.

The bot has been created successfullyThe bot has been created successfully

Next, to use your bot, you need to publish it by clicking Publish. You will then be asked to choose an alias for the bot. Aliases are good for naming different versions of your bot, such as the one you use for development or the one you use for production.

Make a note of the alias name you have entered (e.g. staging). You will need it later.

Adding an alias name to your Amazon Lex BotAdding an alias name to your Amazon Lex Bot

Clicking Publish once more will finalize the setup of your sample bot.

Notification that the bot has been publishedNotification that the bot has been published

Set up the Lex Reference Connection

  • Clone the lex-reference-connection repository from GitHub and follow instructions as described in the readme.

  • Select one of the deployment types as explained in the Running Lex reference connection code section.

  • make a note of the LEX_REFERENCE_CONNECTION argument (e.g. xxxx.ngrok.io, or myserver.mycompany.com:40000), as you will need it later.

Set up the Lex sample Voice API Application

  • Clone the lex-sample-voice-application repository on GitHub and follow the instructions as described in this repository.

  • Select one of the deployment types as explained in the Running Lex sample Voice API application section.

  • Make a note of the phone number linked to your Voice API application as explained in the Set Up Your Vonage Voice API Application Credentials and Phone Number section, as it will be needed for the next step.

Interact Via Voice With the Lex Bot

  • Call the phone number linked to your Voice API application to interact with the Lex bot.

  • You will see on the Lex reference connection application console and the Lex sample voice API application console the transcriptions and sentiment analysis results.

Improving the Lex Bot

When calling the Lex bot using the linked phone number, you may have noticed that the bot does not play a greeting, so the connected caller would be unsure when to start speaking.
Additionally, the bot does not play a confirmation message after you verbally confirmed that you want the appointment.

Let’s improve our example Lex bot by addressing both of those issues.

Get the Lex Bot to Play a Greeting

On your AWS console, go to Amazon Lex, then your Lex bot. Click on the [+] icon next to Intents.

The Lex DashboardThe Lex Dashboard

Next, click on Create Intent.

Creating an intent for a Lex botCreating an intent for a Lex bot

You'll be prompted to enter a name for your new intent. Once you've chosen one, you can click on Add to proceed to the next step.

Entering a name for the intentEntering a name for the intent

Under Sample utterances:

Enter exactly Good morning, which is currently coded in the Lex sample Voice API application as TTS played to Lex bot when the WebSocket is established.

Click on the [+] icon to add the new utterance.

Adding new utterances to a Lex botAdding new utterances to a Lex bot

Next, under Response click on Add Message.

Adding a new message to the bot responderAdding a new message to the bot responder

Enter one or more greeting messages. The content and number of messages are entirely up to you. For example, Hi, how may I help you?, or Hello, what is the reason you are calling?

Do not forget to click on the [+] icon for each entered message.

Adding a message response to a Lex botAdding a message response to a Lex bot

After adding all desired messages, click on Save Intent.

Listing message responsesListing message responses

Next, you will need to rebuild the bot by clicking on Build. After the build completes, go ahead and Publish your bot one more time, as you did before.

You will be asked to enter an alias once again, and you can use the same alias as you did earlier for the sample bot.

Entering 'staging' as the alias for the Lex botEntering 'staging' as the alias for the Lex bot

Testing the Update to the Lex Bot

Call the phone number you have linked to the application from the previous steps, and you will hear “Please wait”. That TTS from the Vonage API platform is played as soon as your call is answered by the platform.

Once the WebSocket is set up, the Vonage API platform plays the TTS “Good morning” to the Lex bot (you as the caller will not hear that).

The Lex bot plays one of the response messages (of the Greeting intent). You hear it over the phone, confirming the connection with the Lex bot.

You may then ask to set up an appointment (with this example Lex bot).

Play an Appointment Confirmation Message

On your AWS console, go to Amazon Lex, then your Lex bot. Click onEdit.

Editing the Lex botEditing the Lex bot

Under Response, click on Add Message.

Adding a new message to the Lex botAdding a new message to the Lex bot

Enter one or more response messages, for example:

Your appointment for {AppointmentType} on {Date} at {Time} has been confirmed. Good bye!

Words inside the curly braces correspond to slots related to this intent.

Then click on the [+] icon to add your new response.

Adding a new message to the Lex botAdding a new message to the Lex bot

To finalize your new message, click on Save Intent.

Finally, to commit these changes, click Build to rebuild the bot with the new changes. Then, you will need to, once again, publish a new version. You can keep the same alias as previous steps.

A successfully published botA successfully published bot

Testing the Updated Lex Bot

To test out these new changes, call the phone number linked to your account and interact with the Lex bot to set up an appointment. This time you will hear the confirmation message you just set up read back to you by the Lex bot.

Tony Chan

Customer Solutions Engineer at Vonage. With a background in product management, network and systems operations, customer support, quality assurance, software development team manager, Tony is working in the Telecommunications industry formerly in France and now in the US. He helps global large and smaller companies develop solutions using programmable voice, messaging, video, and multi-factor authentication services.

Ready to start building?

Experience seamless connectivity, real-time messaging, and crystal-clear voice and video calls-all at your fingertips.