Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product
-
Upload
inovex-gmbh -
Category
Software
-
view
46 -
download
0
Transcript of Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product
![Page 1: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/1.jpg)
Sprachsteuerung mit dem Google Assistant
Add a new User Interface to your Product
Dominik Helleberg
![Page 2: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/2.jpg)
CC 3.0 https://de.wikipedia.org/wiki/2001:_Odyssee_im_Weltraum#/media/File:HAL9000_Better_Reflection.svgCC 3.0 https://en.wikipedia.org/wiki/KITT#/media/File:KITT_Interior_at_Toronto_Auto_Show_2011.jpgCC 2.0 https://commons.wikimedia.org/wiki/Category:Star_Trek:_The_Next_Generation#/media/File:MasterSituationMonitor.jpg
Voice User InterfacesThe Hollywood Version
![Page 3: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/3.jpg)
https://www.youtube.com/watch?v=N3i6NoUZsSwhttps://en.wikipedia.org/wiki/Dragon_NaturallySpeaking#/media/File:Dragon_Naturally_Speaking_Logo.pnghttps://en.wikipedia.org/wiki/Nao_(robot)https://en.wikipedia.org/wiki/Interactive_voice_response#History
Voice User InterfacesThe History
![Page 4: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/4.jpg)
https://en.wikipedia.org/wiki/Sirihttps://en.wikipedia.org/wiki/Cortana_(software)https://en.wikipedia.org/wiki/Google_Voice_Searchhttps://pixabay.com/p-627876/?no_redirect
Voice User InterfacesThe new(er) ones
![Page 5: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/5.jpg)
https://en.wikipedia.org/wiki/Google_Assistanthttps://en.wikipedia.org/wiki/Amazon_Alexahttps://en.wikipedia.org/wiki/Amazon_Echohttps://madeby.google.com/home/
Voice User InterfacesThe hot ones
![Page 6: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/6.jpg)
https://en.wikipedia.org/wiki/Amazon_Echohttps://madeby.google.com/home/
Voice User InterfacesThe hot ones - Features
Nachrichten / News abfragen
Smarthome steuern
Musik abspielen
Wettervorhersage
Chromecast steuern
Wecker / Timer stellenTaxi rufen
Sportergebnisse
TV Programm abfragen
Kochrezepte
Übersetzungen
Kalender vorlesen
ToDo Liste
Fluginformationen
Verkehrslage
Shopping
![Page 7: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/7.jpg)
Voice User InterfacesThe hot ones - APIs
SkillsCustom Skills
Smarthome Skills
Flash Briefing SkillsActions
on GoogleConversational Actions
Direct Actions
https://en.wikipedia.org/wiki/Amazon_Echohttps://madeby.google.com/home/
![Page 8: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/8.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction Fulfillment
Natural Language Understanding
![Page 9: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/9.jpg)
Voice User InterfacesActions on Google
![Page 10: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/10.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
![Page 11: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/11.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
Action Selection
![Page 12: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/12.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction
![Page 13: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/13.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction Fulfillment
![Page 14: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/14.jpg)
Voice User InterfacesActions on Google
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction Fulfillment
![Page 15: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/15.jpg)
Voice User InterfacesActions on Google – Smart Transport
GoogleHome
Speech Recognition
Action Selection
![Page 16: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/16.jpg)
Voice User InterfacesActions on Google – Smart Transport
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction
![Page 17: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/17.jpg)
Voice User InterfacesActions on Google – Smart Transport
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction Fulfillment
https://
![Page 18: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/18.jpg)
Voice User InterfacesActions on Google – Smart Transport
Welcome Message
WELCOME_INTENT
Complete Entities?
Suchanfrage
Query Entities
Nein Ja
Antwort (1. Verbindung)
„Nächste“
Antwort (2. Verbindung)
Query Fulfillment
![Page 19: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/19.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 20: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/20.jpg)
Voice User InterfacesActions on Google – Smart Transport
Entities
Name Type ReqFrom * +To * +Depature_Date Date (sys)Depature_Time Time (sys)Transport_Type „Bus“,
„Tram“, ..
![Page 21: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/21.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 22: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/22.jpg)
Voice User InterfacesActions on Google – Smart Transport
Welcome Message
WELCOME_INTENT
![Page 23: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/23.jpg)
Voice User InterfacesActions on Google – Smart Transport
Complete Entities?
Suchanfrage
![Page 24: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/24.jpg)
Voice User InterfacesActions on Google – Smart Transport
Complete Entities?
Suchanfrage
![Page 25: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/25.jpg)
Voice User InterfacesActions on Google – Smart Transport
Complete Entities?
Suchanfrage
![Page 26: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/26.jpg)
Voice User InterfacesActions on Google – Smart Transport
Complete Entities?
Suchanfrage
![Page 27: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/27.jpg)
Voice User InterfacesActions on Google – Smart Transport
Antwort (1. Verbindung)
„Nächste“
Antwort (2. Verbindung)
![Page 28: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/28.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 29: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/29.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 30: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/30.jpg)
Voice User InterfacesActions on Google – Smart Transport
Welcome Message
WELCOME_INTENT
Complete Entities?
Suchanfrage
Query Entities
Nein Ja
Antwort (1. Verbindung)
„Nächste“
Antwort (2. Verbindung)
Query Fulfillment
Ready to publish?
Let‘s beta test... No.
![Page 31: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/31.jpg)
Voice User InterfacesActions on Google – Smart Transport - Testing
GoogleHome
Speech Recognition
Action Selection
IntentSelection
EntityExtraction Fulfillment
ChatBot
![Page 32: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/32.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 33: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/33.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 34: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/34.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 35: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/35.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 36: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/36.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 37: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/37.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 38: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/38.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 39: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/39.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 40: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/40.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 41: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/41.jpg)
Voice User InterfacesActions on Google – Smart Transport
![Page 42: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/42.jpg)
Voice User InterfacesActions on Google – Smart Transport
• Beta Tests sind sinnvoll
• User finden unsere Features nicht
• Dafür möchten sie andere Features
• Entities sind immer zu überprüfen
• Deutsch / Englisch zu mischen ist keine good idea...
![Page 43: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/43.jpg)
Voice User InterfacesActions on Google – Smart Transport
Demo Time
![Page 44: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/44.jpg)
Voice User InterfacesLessons Learned
• VUI‘s vs. ChatBots
![Page 45: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/45.jpg)
Voice User InterfacesLessons Learned
• VUI‘s vs. ChatBots
• User fragen sehr spezifische Dinge
• VUI‘s sind gut für kurze, präzise Informationen / Abläufe
• Reaktionszeiten sind wichtig
• Benutzerführung ist wichtig
• Automatisierung / Deployment noch nicht vorhanden
• Neue „Gatekeeper“
![Page 46: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/46.jpg)
Voice User InterfacesSummary / Outlook
• Speech Recognition ist deutlich besser
• NLU braucht noch Verbesserungen
• Abläufe sind immer noch geskripted
• Multi-Account
• Privacy / Security
• Rückkopplung an andere UIs
• Discovery
• Testing
![Page 47: Sprachsteuerung mit dem Google Assistant – Add a new User Interface to your Product](https://reader031.fdocuments.in/reader031/viewer/2022030312/58ed78381a28ab96728b4769/html5/thumbnails/47.jpg)
Voice User InterfacesSummary / Outlook
• VUIs sind schon ziemlich cool, aber
Alexa, Du musst echt noch viel lernen...
Danke