Dragon Mobile Assistant - Nuance Communications one of TIME Magazine’s ’50 Best Android Apps for...


Overview

Named one of TIME Magazine’s ’50 Best Android Apps for 2013, Dragon Mobile Assistant is a lead example in the latest and greatest design, feature and technical concepts in the intelligent personal assistant space. Using Nuance’s renowned language understanding, ambient intelligence and expressive voice technology, Dragon Mobile Assistant actively listens, interprets commands, and provides a flexible, adaptive, and intuitive experience for users.


2013 Q1’13 Q2’13 Q3’13 Q4’13 2014

R3.0

•  Web Search •  Trip Advisor •  Launch Maps •  Connect to

Facebook •  Bluetooth Integration

Release Milestones (2012 – 2014) R4.0 •  TTS read back •  Support Reminders •  Location Services •  Driver Mode •  Email Dictation

R4.2 •  Network TTS •  Revised Menu and

Settings •  Streamlined Sign Up and

Home Screen

R5.1 •  Calendar Search and

Edit •  Device Setting Voice

Management •  Weather Card •  Knowledge Card

R3.1 •  Location Sharing •  Wake-Up Phrase •  TTS Read back Caller

Name •  Alert to Support MMS

R4.1 •  Location Sharing updates •  Multiple TTS Voice Options •  Read back of SMS and

Notifications •  Double tap Home Key

launches DMA

R5.0 •  Wake Up Phrase & One Shot

Command •  First app to utilize Nuance

Cloud Services platform •  Introduction of Cards and

Receipts experience

R2.0

•  Music playback •  Open applications •  Create new alarm •  Alert and TTS read

back of incoming SMS

•  Voice dialing

R1.0

•  First Launch •  Calling, Texting,

command and control

•  DragonGo! Web search and results

Q4’12 Q1’14

R5.2 •  Nuance Voice Print

(voice biometrics) •  Landscape Mode •  New Web Browser +

content sharing experience


Reviewer’s Guide

The following section showcases some of the highlights and innovative features of Nuance’s Dragon Mobile Assistant.


Setup Instructions NOTE: Only Android versions 4.0 and higher are supported 1.  On your device, Go to Settings > Security > Unknown Source 2.  Check the following box: “Allow installation of apps from sources other than the Play

Store.” 3.  Install the application (APK) provided to you by Nuance PR or Media team contact by

sending it to the device via USB file sharing, as an email attachment sent to your device (or whatever your preferred method might be).

4.  Find the file on your device, either in Downloads or in your email and click on it. 5.  When the device prompts you regarding if you want to keep the file anyway, click ‘OK’. 6.  Click on “Install” to install the application. 7.  Press OK to allow the application permissions to access features of the device. 8.  Open the app. 9.  Login with your Facebook account. 10.  Skip the ‘Create Voice Print’ popup – (we will take you through that process a bit later) 11.  Go to Settings > Accounts and login to your Twitter and Netflix accounts


Application Features Nuance has developed a variety of features for users to interact naturally and intuitively. Here are a few of Dragon Mobile Assistant’s most popular features:

Send a text Find restaurants and make reservations Access content and information from a wide variety of websites

Make a call Wake up your assistant and ask it to do something all in one command Post to Twitter and Facebook

Launch an app Look up local businesses and points of interest Notification and Alert Read-back

Play on-device music Check the weather Hands free Voice Wake up of Dragon Mobile Assistant

Set an alarm and get the current time Use maps and find directions Multiple Voice options for your

assistant Create or Search an event in

your calendar Auto detection of traveling (Driver Mode) Customize your assistant’s wake up phrase


Natural Interaction - Your choice. Dragon Mobile Assistant allows for flexible, natural controls for calling, messaging, creating calendar events, looking up maps and directions and accessing social media. Users can perform a task with either a single command for advanced users, or Dragon will ask questions and offer guidance to help users fill in the details.

Single command or ‘One-shot’ 1. User: “Create an appointment tomorrow at 7pm called Dinner with John”

Complex task or ‘Multi-step’ 1.  User: “I need to create an appointment” 2.  Dragon: “When is it for?” 3.  User: “7pm tomorrow” 4.  Dragon: “Here is your appointment, would you like to save, edit or

cancel it?” 5.  User: “Change the subject to “Dinner with John” 6.  Dragon: “I’ve update the title. Should I go ahead and schedule it?” 7.  User: “Yes”


Customize Your Wake-up phrase

Set your customized Wake-up phrase 1.  Go to the Settings Menu 2.  Select “Wake-up” 3.  Select “Wake-up phrase” 4.  Type your preferred Wake-up phrase over the

‘Hello Dragon’ default. (“Hello Dude”, “Hello Jonathan”, etc)

5.  Select “OK”

Choose how you want to get your Dragon’s attention by creating your own Wake-up phrase.

Now Try it out: 1. Speak the Wake-up phrase to launch the app.


Attentive Mode

Set Attentive Mode 1.  Slide out the side Shortcut Menu 2.  Select “Attentive Mode” 3.  Create your Nuance Voice Print 4.  Select “OK” to the accept the notice

Get your assistants attention, hands free, even when your device is asleep or in lock mode.

Now Try it out: 1. Exit out of the app and lock your phone screen 2. Say “[Wake-up phrase], Where’s the nearest Starbucks?”


Auto-Detect Driver Mode

Set Auto-Detect Driver Mode 1.  Go to the Settings Menu 2.  Select “Driver Mode” 3.  Select “Auto-enable Driver Mode” 4.  Check “While Driving” 5.  Select “Enable”

This feature automatically detects when you are in a moving vehicle and switches to hands-free, eyes-free experience, keeping users connected in a safer (and smarter) way.

Now Try it out: 1.  Mount your device safely before driving 2.  The app will automatically change to

driver mode after a short period of time.


Notifications Read back

Set Notification Read back 1.  Go to the Settings Menu 2.  Select “Read back Notifications” 3.  Select “Notifications to Read” 4.  All are default selected, besides Facebook 5.  Select “Facebook Newsfeed”

Alerts, notifications and Facebook newsfeed updates can be read out loud. After read back, you can respond, post to Facebook or any number of other actions.

Now Try it out: 1. The next time you get an SMS or calendar popup, the app will read it back to you. 2. You will have Facebook updates read back at specific intervals


Try These Out.

Make a call User: “[Wake-up phrase], call John at work” Or “[Wake-up phrase], ring Ashley on her mobile” Send a message User: “[Wake-up phrase], Tell Natalie, I’m on my way home” Or “[Wake-up phrase], Send Neil a message saying We landed on the moon!” Create an event in your calendar User: “[Wake-up phrase], Make an appointment this Sunday at 1:30 pm” Update Facebook or Twitter User: “[Wake-up phrase], Update Facebook, Anyone up for apple picking? Or: “[Wake-up phrase], Send out a new Tweet, What an incredible finish to the game! Look up information and content User: “[Wake-up phrase], When is Finding Nemo 3D playing today? Or: “[Wake-up phrase], Show me reviews for the New England Aquarium

Here are the most popular spoken user commands in Dragon Mobile Assistant. Give ‘em a go.

Use maps and find directions User: “[Wake-up phrase], Get directions to Fenway Park” Or: “[Wake-up phrase], Show me a map of Chicago” Get answers to interesting questions User: “[Wake-up phrase], How tall is the Eifel Tower?” or “What’s the square root of 45?” Searching for businesses User: “[Wake-up phrase], Staples in Cambridge Massachusetts” Or: “[Wake-up phrase], Hardware stores nearby” Check the weather User: “[Wake-up phrase], What’s the weather going to be like today? ” Or: “[Wake-up phrase], What’s the forecast for San Francisco?” Launch an App (requires applications to be installed on your device) User: “[Wake-up phrase], Open calculator” Or: “[Wake-up phrase], Launch Angry Birds” Play Music (requires music to be on your device) User: “[Wake-up phrase], Play Katy Perry”


What’s New in Version 5.2? Our latest update brings to life Nuance Voice Print voice biometrics, the introduction of Landscape Mode, and a redesigned Web Browsing experience. Here are some of the highlights:

ü  User Recognition: Upon creating their own Nuance Voice Print, users can now speak their wake up phrase and command and their assistant will respond to them and only them, making it a truly personal experience.

ü  New Semantic Web Browser experience: We have redesigned the user experience for web search and results. Optimized for performance and ‘at a glance’ ease of use, the new experience is more intuitive and faster than ever before.

ü  Landscape Mode: You asked, we listened. Landscape mode is now fully supported through the application – giving users another way to interact with their assistant. Driver Mode is now even better when users dock in Landscape mode.


Nuance Voice Print (voice biometrics)

1.  Go to Settings > Wake-up > Create Voice Print 2.  Follow the instructions to create your own Voice Print.

(Alternatively, users that want to try out Attentive Mode or Driver Mode now can have an enhanced experience by training a voice print before using those features.)

Allow your personal assistant to respond to you - and only you – with Voice Print - Nuance’s powerful voice biometrics solution.

Now Try it out: 1.  Say “[Wake-up phrase], Where’s the nearest Starbucks?” 2.  Have your friends speak the same Wake-up phrase and

command to confirm the app ignores anyone but you.


An all-new Web Browsing Experience

Interact with the all new Browser. 1.  Speak “Hello Dragon, Show me a picture of an

Elephant.” 2.  You can now interact directly from the web

results and select alternative result options directly from the browser.

3.  You can now share web result content. Simply press the top menu icon in the browser to see sharing options.

Engage more content. We’ve rethought a new in-app browser experience for interacting and sharing content from your assistant.


Landscape Mode

Try it out: Just turn your phone sideways! 1.  Dragon Mobile Assistant can do

everything you have grown to expect, but now render it in Landscape orientation.

2.  Driver mode is now optimized, so go ahead and dock your device and give your first command.

Ask and you shall receive: Dragon Mobile Assistant now fully supports Landscape Mode.


Press Kit Reach out to [email protected] for a link to more information on Nuance’s Dragon Mobile Assistant.

Dragon Mobile Assistant - Nuance Communications one of TIME Magazine’s ’50 Best Android Apps for...

Documents

Transcript of Dragon Mobile Assistant - Nuance Communications one of TIME Magazine’s ’50 Best Android Apps for...