Human-Computer Interaction Lecture 4: Inference-based approaches.
-
Upload
godfrey-pope -
Category
Documents
-
view
233 -
download
1
Transcript of Human-Computer Interaction Lecture 4: Inference-based approaches.
![Page 1: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/1.jpg)
Human-Computer Interaction
Lecture 4: Inference-based approaches
![Page 2: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/2.jpg)
WHAT MAKES SYSTEMS ‘INTUITIVE’?
![Page 3: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/3.jpg)
![Page 4: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/4.jpg)
From Part 1a Software Design …
![Page 5: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/5.jpg)
![Page 6: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/6.jpg)
output input
input output
The human operator as a black box
UserUser ComputerComputer
keypresses & gestures
visualrepresentation
![Page 7: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/7.jpg)
longterm
memory
workingmemory
vision
motioncontrol
problemsolving
input
output
![Page 8: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/8.jpg)
![Page 9: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/9.jpg)
What is going on inside that thing?
How can I get it to do what I want?
![Page 10: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/10.jpg)
What is going on inside that thing?
How can I get it to do what I want?
?
![Page 11: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/11.jpg)
MENTAL MODELS
![Page 12: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/12.jpg)
![Page 13: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/13.jpg)
![Page 14: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/14.jpg)
![Page 15: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/15.jpg)
![Page 16: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/16.jpg)
![Page 17: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/17.jpg)
![Page 18: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/18.jpg)
![Page 19: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/19.jpg)
Mental models
• Study of the mental representations used for everyday problem-solving by ordinary people
• Can be more or less structured:– From narrative descriptions in a user persona– To AI-style cognitive models of state-space planning
• The mental model of the user is not the mental model of the designer …– but can be influenced by the designer.
![Page 20: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/20.jpg)
User’s model
![Page 21: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/21.jpg)
Designer’s model?
Wiring closet
Toilets
Kitchen
Stairs
Plantroom
![Page 22: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/22.jpg)
Designer’s model
Dry
Wet
![Page 23: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/23.jpg)
What happened?Data discarded?
Translation?Override?
Two clipboards?Layers?
What happened?Data discarded?
Translation?Override?
Two clipboards?Layers?
Solving problems with mental models
Copy inIllustrator
Paste inPhotoshop
Copy inIllustrator
Paste inWord
Can’tedit text
Canedit text
![Page 24: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/24.jpg)
![Page 25: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/25.jpg)
![Page 26: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/26.jpg)
Think-aloud studies
• Attempt to study a user’s mental model directly in a controlled task– Originally for research into “problem-solving”
• Subject talks continuously while performing task.– Transcribed as a verbal protocol for detailed study
• Also used to “evaluate” software when no alternative designs are available
• Or even when you don’t have any software at all!– (how?)
![Page 27: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/27.jpg)
Pay no attention to the man behind the curtain!
‘Wizard of Oz’studies
![Page 28: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/28.jpg)
Wizard-of-Oz implementation
• Originally invented to evaluate artificially intelligent dialogue systems– User typed on a real computer, but computer answers
were simulated by a ‘man behind the curtain’
• With a paper prototype, it’s not necessary to hide behind a curtain!– Just ask the user to ‘click’ by pointing on your paper
prototype– Simulate the system response by sticking on another Post-
it note ‘window’, or replacing the piece of paper
• Paper can be more or less ‘low-fidelity’
![Page 29: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/29.jpg)
Low-fidelity prototypes
![Page 30: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/30.jpg)
Computer tools for lo-fi prototyping
• Some of the WoZ functions can use a computer:– e.g. DENIM from University of Washington– Take photographs of your paper sketches– Display the rough pencil drawings on the screen– Define control areas and ‘buttons’– Simulation tool changes to other sketch screens in
response to user actions
• Variants– SILK – ‘sketch’ by drawing on the screen itself– Or just load sequence of photos on an iPod and flick
through them
• The ‘sketchy’ appearance helps users comment
![Page 31: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/31.jpg)
DENIM
![Page 32: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/32.jpg)
Storyboard or ‘click-through’ prototypes
• Doesn’t allow user interaction, but does help them imagine what the system will be like to use.
• PowerPoint is the most commonly used tool– Load a series of screen mockups– Move the mouse pointer over the screen as though you
are controlling it– Point at a button and click– (but of course, Powerpoint will always go to the next slide,
regardless of where the pointer is when you click)
![Page 33: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/33.jpg)
![Page 34: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/34.jpg)
![Page 35: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/35.jpg)
![Page 36: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/36.jpg)
![Page 37: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/37.jpg)
![Page 38: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/38.jpg)
![Page 39: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/39.jpg)
![Page 40: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/40.jpg)
![Page 41: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/41.jpg)
![Page 42: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/42.jpg)
![Page 43: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/43.jpg)
![Page 44: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/44.jpg)
![Page 45: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/45.jpg)
![Page 46: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/46.jpg)
USER MODELS (≠ MENTAL MODELS)
![Page 47: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/47.jpg)
What is going on inside that thing?
How can I get it to do what I want?
![Page 48: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/48.jpg)
(BAYESIAN) USER MODELS
![Page 49: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/49.jpg)
A probabilistic view of user interaction
• Machine:– I know how to do several things.– I wonder which one the user wants me to do?
• User:– This machine can do a whole bunch of stuff.– What is most likely to make it do the right stuff?
• Machine:– I think the user has made a mistake
• User:– I think the machine has made a mistake
![Page 50: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/50.jpg)
Bayes theorem (for Bayesian inference)
H: HypothesisE: Evidence
Posterior probability of Hypothesis after taking new Evidence into account
Prior inferred probability of this Hypothesis before new Evidence became available.
If Hypothesis is true, how likely is it that we would see
this Evidence?
What is the probability of seeing E, under all possible
hypotheses?
P(H|E) = P(E|H)
P(E)P(H)
![Page 51: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/51.jpg)
Bayesian inference inference of user intention
D: User wants to Delete all their filesR: User has typed ‘rm –rf’
Probability that user wants to delete all files, given that they just typed ‘rm –rf’
(Prior) probability that user wanted to delete all files before we saw this.
If user does want to delete all files, how likely is it that they would type ‘rm –rf’?
What is the probability user would type ‘rm –rf’, under all
possible hypotheses?
P(D|R) = P(R|D)
P(R)P(D)
![Page 52: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/52.jpg)
The case of Clippy
![Page 53: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/53.jpg)
![Page 54: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/54.jpg)
![Page 55: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/55.jpg)
Flash Fill: programming by example
![Page 56: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/56.jpg)
‘Semantic pointing’
![Page 58: Human-Computer Interaction Lecture 4: Inference-based approaches.](https://reader031.fdocuments.in/reader031/viewer/2022012914/56649f0c5503460f94c20440/html5/thumbnails/58.jpg)