Applying Science to Conversational UX Design
-
Upload
raphael-arar -
Category
Design
-
view
169 -
download
0
Transcript of Applying Science to Conversational UX Design
![Page 1: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/1.jpg)
Applying Science to Conversational UX DesignBob Moore, Raphael Arar
IBM Research
![Page 2: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/2.jpg)
Interfaces have come a long way.
![Page 3: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/3.jpg)
Applying Science to Conversational UX Design© 2017 IBM Research
![Page 4: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/4.jpg)
![Page 5: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/5.jpg)
![Page 6: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/6.jpg)
![Page 7: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/7.jpg)
Conversational Agents
![Page 8: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/8.jpg)
![Page 9: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/9.jpg)
“
Jean Baudrillard Sociologist
The sad thing about artificial intelligence is that it lacks artifice and therefore intelligence.
![Page 10: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/10.jpg)
Human Conversation
APIs
Conversational Systems
Speech to Text Text to SpeechNatural LanguageUnderstanding Dialog Management
![Page 11: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/11.jpg)
Human Conversation
APIs
Conversational Systems
Text to SpeechSpeech to Text Natural LanguageUnderstanding Dialog Management
![Page 12: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/12.jpg)
USER EXPERIENCE DESIGN
ARCHITECTURE
INFORMATIONARCHITECTURE
HUMAN-COMPUTERINTERACTION
INTERACTIONDESIGN
VISUAL DESIGN
MECHANICALENGINEERING
ELECTRICALENGINEERING
CONTENT CREATION(Text, Data, Graphics)
Signage
Info Viz
Navigation INTERFACE DESIGN
Ubicomp
Controls
InteractiveEnvironments
USABILITY ENGINEERING
INDUSTRIALDESIGN
Dan Saffer, UX Designer
![Page 13: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/13.jpg)
USER EXPERIENCE DESIGN
ARCHITECTURE
INFORMATIONARCHITECTURE
HUMAN-COMPUTERINTERACTION
INTERACTIONDESIGN
CONVERSATION DESIGN
MECHANICALENGINEERING
ELECTRICALENGINEERING
CONTENT CREATION(Text, Data, Graphics)
Signage
Ontology Management
Navigation CONVERSATIONAL UI
Ubicomp
Controls
InteractiveEnvironments
USABILITY ENGINEERING
INDUSTRIALDESIGN
![Page 14: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/14.jpg)
What’s the state-of-the-art for conversational UI?
![Page 15: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/15.jpg)
Web. 2017.
![Page 16: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/16.jpg)
Applying Science to Conversational UX Design© 2017 IBM Research
![Page 17: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/17.jpg)
Web. 1996.
![Page 18: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/18.jpg)
![Page 19: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/19.jpg)
Conversational UI. 2017.
![Page 20: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/20.jpg)
![Page 21: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/21.jpg)
Conversational UI. ????
![Page 22: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/22.jpg)
Human Conversation
APIs
Conversational Systems
Text to SpeechSpeech to Text Natural LanguageUnderstanding Dialog Management
![Page 23: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/23.jpg)
Conversational Systems
Dialog Management
Conversation Analysis
Human Conversation
![Page 24: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/24.jpg)
What does natural conversation sound like?
![Page 25: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/25.jpg)
20 Des: What is the name?21 Guy: Detweiler. D-e-t, 22 (1.2)23 Guy: w-e, 24 (0.4)25 Guy: i-l-e-r-. 26 (2.0)27 Des: Foursome? 28 Guy: Yah. 29 (0.4)30 Des: Electric carts? 31 (0.6)32 Guy: Uh:::, n:no? I don’t33 think so. 34 Des: Okay. We'll see yuh then, 35 Guy: Righto, 36 Des: Mm hm, Bye?
01 Des: G'morning. San Juan Hills 02 Country Club? 03 Guy: Guh morning. What’s-w-what 04 kind of a starting time05 ken:: we get fer::hh06 sometime this afternoon. 07 (0.7)08 Guy: Any[time- 09 Des: [Oh:::, [let's see.10 Guy: [Any time11 tuhday. 12 Des: Two fordy. One, thirdy. 13 Guy: One thirty? 14 Des: Mm hm::? 15 Guy: One thirty. 16 (0.7)17 Guy: .hh W'l at sounds like a18 good time? 19 (0.4)
![Page 26: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/26.jpg)
Not every voice or text interaction is a conversation.
![Page 27: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/27.jpg)
Speaker-change recurs, or at least occurs.1
Overwhelmingly, one party talks at a time.2
Occurrences of more than one speaker at a time are common, but brief.3
Transitions (from one turn to a next) with no gap and no overlap are common. Together with transitions characterized by slight gapor slight overlap, they make up the vast majority of transitions4
Turn order is not fixed, but varies.5
Turn size is not fixed, but varies.6
Length of conversation is not specified in advance.7
Relative distribution of turns is not specified in advance.9
Number of parties can vary.10
Talk can be continuous or discontinuous.11
Turn-allocation techniques are obviously used. A current speaker may select a next speaker (as when he addresses a question toanother party); or parties may self-select in starting to talk12
Various 'turn-constructional units' are employed; e.g., turns can be projectedly 'one word long', or they can be sentential in length13
Repair mechanisms exist for dealing with turn-taking errors and violations; e.g., if two parties find themselves talking at the same time, one of them will stop prematurely, thus repairing the trouble14
What parties say is not specified in advance8
— Harvey Sacks, Emanuel A. Schegloff, Gail Jefferson
![Page 28: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/28.jpg)
Meet AlmaNatural Conversation Framework
![Page 29: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/29.jpg)
Natural Language != Natural Conversation
![Page 30: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/30.jpg)
intent
distance
cuisine place
Natural Language
![Page 31: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/31.jpg)
Natural Conversation
action pair
granting
request
![Page 32: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/32.jpg)
dependency
sequence closing
hearing trouble
dependency
dependency
understanding trouble
base second part
base first part
![Page 33: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/33.jpg)
![Page 34: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/34.jpg)
![Page 35: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/35.jpg)
Conversational UXa working set of principles
![Page 36: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/36.jpg)
Saying is doing
![Page 37: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/37.jpg)
J: T's- tsuh beautiful day out isn't it?L: Yeh it's jus' gorgeous...
CA
A: God izn it dreary. (0.6)B: [Y'know I don't think-A: [.hh- It's warm though,
![Page 38: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/38.jpg)
UX
“A "signifier" is some sort of indicator, some signal in the physical or social world that can be interpreted meaningfully.
Don Norman Cognitive Scientist
![Page 39: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/39.jpg)
Recipient design
![Page 40: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/40.jpg)
CA
“By 'recipient design' we refer to a multitude of respects in which the talk by a party in a conversation is constructed or designed in ways which display an orientation and sensitivity to the particular other(s) who are the co-participants.
Harvey Sacks, Emanuel A. Schegloff, Gail Jefferson Sociologists
![Page 41: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/41.jpg)
B: Who's doing your remodel?A: Dave
CA
C: Who's doing your remodel?A: My neighbor across the street. He's a contractor.
![Page 42: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/42.jpg)
UX
“[Human-centered design is] an approach that puts human needs, capabilities, and behavior first, then designs to accommodate those needs, capabilities, and ways of behaving.
Don Norman Cognitive Scientist
![Page 43: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/43.jpg)
Minimization
![Page 44: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/44.jpg)
D: Who's doing your remodel?
CA
A: DaveD: Who?A: You know, my neighbor across the street.D: Oh!A: You had a beer with him?D: Right.
![Page 45: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/45.jpg)
CA
B: uh, yeah, I guess I'd like Mexican foodA: Mañana's is on Fourth and Winchester. It's a great Mexican restaurant within walking distance. It gets five out of five stars. Would you like me to make a reservation for you at Mañana's?
A: What kind of food would you like?Mexican
Voice inputs are cheap, but voice outputs are expensive
![Page 46: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/46.jpg)
UX
Occam’s Razor1
Minimize Cognitive Load2
Eliminate Excise3
![Page 47: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/47.jpg)
Understanding is interactional
![Page 48: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/48.jpg)
CA
![Page 49: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/49.jpg)
UX
Mental Models1
Feedback2
![Page 50: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/50.jpg)
Emotions describe actions
![Page 51: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/51.jpg)
CA
![Page 52: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/52.jpg)
CA
![Page 53: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/53.jpg)
UX
Visceral Behavioral Reflexive
Norman’s 3 Levels of Emotional Design
![Page 54: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/54.jpg)
The best input method is situational
![Page 55: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/55.jpg)
![Page 56: Applying Science to Conversational UX Design](https://reader031.fdocuments.in/reader031/viewer/2022021921/58f9a9b3760da3da068b7165/html5/thumbnails/56.jpg)
UX
Context matters!