Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language...
Transcript of Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language...
![Page 1: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/1.jpg)
© 2016, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Sébastien Stormacq, Senior Solution Architect
June 30th 2016
Enabling voice-based interactions with Amazon Alexa and AWS Lambda
![Page 2: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/2.jpg)
![Page 3: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/3.jpg)
![Page 4: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/4.jpg)
When you have a ques-on or want to do something, all you have to do is ask.
![Page 5: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/5.jpg)
![Page 6: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/6.jpg)
![Page 7: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/7.jpg)
![Page 8: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/8.jpg)
![Page 9: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/9.jpg)
![Page 10: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/10.jpg)
Customer feedback
10
![Page 11: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/11.jpg)
![Page 12: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/12.jpg)
B U I L D I N G A N E C O S Y S T E M F O R A L E X A
![Page 13: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/13.jpg)
Create Great Content: ASK is how you connect to your consumer
THE ALEXA ECOSYSTEM Supported by two powerful frameworks
A L E X A V O I C E S E R V I C E
Unparalleled Distribution: AVS allows your content to be everywhere
Lives In The Cloud
Automated Speech Recognition (ASR)
Natural Language Understanding (NLU)
Always Learning
A L E X A S K I L L S K I T
![Page 14: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/14.jpg)
UNDER THE HOOD OF ASK A closer look at how the Alexa Skills Kit process a request and returns an appropriate response
You Pass Back a Textual or Audio Response
You Pass Back a Graphical Response
Alexa Converts Text-to-Speech (TTS) & Renders Graphical Component
Respond to Intent through Text & Visual
Alexa sends Customer Intent to Your Service User Makes a
Request Alexa Identifies Skill & Recognizes Intent Through ASR & NLU
Your Service processes Request
Audio Stream is sent up to Alexa
![Page 15: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/15.jpg)
B U I L D I N G Y O U R V O I C E E X P E R I E N C E
![Page 16: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/16.jpg)
WHERE DO WE START? The Evolution of a Skill
Traffic Skill Example Give an estimated time of arrival from home to work.
Traffic Skill Example Include accidents, construction and closures on route.
Traffic Skill Example Proactively alert user to delays and provide alternate routes.
R U N Evolve Over Time
C R A W L What’s Your Core Functionality?
ANALYZE USER FEEDBACK & OPTIMIZE SKILL
W A L K Expand Capabilities & Features
INNOVATE FOR CUSTOMERS
![Page 17: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/17.jpg)
THE PLAN High-Level Framework to help get you started
We’ve put together a plan to take your projects from inception to launch through a honed process that includes multiple touch-‐points with the Alexa team.
V O I C E E X P E R I E N C E D E S I G N
1
Establish Strategic & Creative Direction What’s Your MVP?
Develop User Flows & Scripts Prepare Utterances & Responses
2
D E V E L O P M E N T
Bring the Skill to Life Initial Skill Submission
Deliver Skill to Amazon For Review
3 T E S T I N G & C E R T I F I C AT I O N
Amazon & Developer Testing & Adjustments CertiSication & Deployment
START
END
![Page 18: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/18.jpg)
L E T ’ S B U I L D A N E W S K I L L F O R A L E X A
![Page 19: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/19.jpg)
ALEXA SKILL K IT High Level Overview
Your Code
![Page 20: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/20.jpg)
ALEXA SKILL K IT High Level Overview
Amazon EC2
![Page 21: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/21.jpg)
ALEXA SKILL K IT High Level Overview
Availability Zone 1
Web tier
App tier
RDS (Master) Availability
Zone 2 RDS
(Standby)
![Page 22: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/22.jpg)
ALEXA SKILL K IT High Level Overview
Elastic Beanstalk environment
Auto Scaling group
Elastic Beanstalk container
Auto Scaling group
Elastic Beanstalk container
Prod 1
Prod 2
Route 53
![Page 23: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/23.jpg)
ALEXA SKILL K IT High Level Overview
AWS Lambda
![Page 24: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/24.jpg)
ALEXA SKILL K IT Voice Model
Intents
Utterances
Slots
![Page 25: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/25.jpg)
ALEXA SKILL K IT Voice Model
Intents
Utterances
Slots
![Page 26: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/26.jpg)
ALEXA SKILL K IT Voice Model
Intents
Utterances
Slots
![Page 27: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/27.jpg)
ALEXA SKILL K IT Voice Model
Intents
Utterances
Slots
![Page 28: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/28.jpg)
ALEXA SKILL K IT NodeJS Code
![Page 29: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/29.jpg)
ALEXA SKILL K IT Developer Console
![Page 30: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/30.jpg)
ALEXA SKILL K IT Developer Console
![Page 31: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/31.jpg)
ALEXA SKILL K IT Developer Console
![Page 32: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/32.jpg)
ALEXA SKILL K IT Developer Console
![Page 33: Enabling voice-based interactions · Automated Speech Recognition (ASR) Natural Language Understanding (NLU) Always Learning ALEXA SKILLS KIT . UNDER THE HOOD OF ASK A closer look](https://reader035.fdocuments.in/reader035/viewer/2022070910/5fa08f169a9483241e68a07f/html5/thumbnails/33.jpg)
Thank you Sébastien Stormacq [email protected]