Holistic Usability Measure VUI Design: Philosophy and Practice.
-
Upload
myron-thomas -
Category
Documents
-
view
221 -
download
2
Transcript of Holistic Usability Measure VUI Design: Philosophy and Practice.
![Page 1: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/1.jpg)
Holistic Usability MeasureVUI Design: Philosophy and Practice
![Page 2: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/2.jpg)
2 of 18
VUI Design: Science vs. Art
Our session was described as “... dives deep into some of the science-versus-art issues in dialog design.”
![Page 3: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/3.jpg)
3 of 18
Art & Science in VUI Design
VUI Design is both an Art and Science
![Page 4: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/4.jpg)
4 of 18
Art & Science in VUI Design
Art in VUI Design Creative uses of text/speech
More than 1 way to say something Creative uses of audio “Color” in the interface
Voice talent Mood of the interface
![Page 5: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/5.jpg)
5 of 18
Art & Science in VUI Design
Science in VUI Design Usability
Measurable metrics Human factors
Short term memory Software engineering
Reuse Development
![Page 6: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/6.jpg)
6 of 18
Art & Science in VUI Design
What really matters?
![Page 7: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/7.jpg)
7 of 18
Usability! “If you could build a system
that resulted in world peace, but no one could use it ... it would be useless. Usability matters.” – Gilbert
However, “there has been no generally agreed-upon method of measuring usability, which makes it difficult to compare among different findings.” - Polkosky
![Page 8: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/8.jpg)
Holistic Usability Measure
![Page 9: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/9.jpg)
9 of 18
VUI Goals
What is the goal of your VUI?
Who decides the primary goal of the VUI? Designer Client Manager
![Page 10: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/10.jpg)
10 of 18
VUI Goals
Did you build the right VUI? Who decides?
How do you know if your VUI is better than another that does the same tasks?
You must test it!
![Page 11: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/11.jpg)
11 of 18
Background
During requirement analysis, before design Information design; what is to be built What is the VUI suppose to accomplish? Who are the users? Etc.
These are typical, but most people miss Usability metrics These are typically an afterthought As a result, usability gets cut
![Page 12: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/12.jpg)
12 of 18
Background
Quantitative Metrics Speech recognition accuracy Task completion time
Subjective Metrics User friendliness Ease of use
![Page 13: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/13.jpg)
13 of 18
Background
Which metrics are most important? It depends on your VUI Decide how you will test your VUI before you
design it
Given several different metrics How do you measure the overall effectiveness
of the VUI?
![Page 14: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/14.jpg)
14 of 18
Holistic Usability Measure
HUM Assign each metric a weight (1 – 99%) based on
its importance
Design and implement the VUI
Evaluate the VUI Convert all metrics to a similar numerical scale
![Page 15: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/15.jpg)
15 of 18
Holistic Usability Measure
HUM = W1*Metric1 + W2*Metric2 + ... + Wn*Metric n
where W1 + W2 + ... + Wn = 1
and 0 ≤ W1, W2, ..., Wn ≤ 1
HUM yields a percentage measure rating the VUI’s usability.
![Page 16: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/16.jpg)
16 of 18
Conclusions
VUI Design is both an Art & Science However, what really matters is usability
The goodness of your VUI can only be determined through usability testing Otherwise, you are guessing
Testing is essential!
![Page 17: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/17.jpg)
17 of 18
Conclusions HUM is a tool for testing
It reports usability with respect to the VUI goals
Multiple ways to design same VUI. Which one is the best? HUM is ideal for comparing more than one implementation of the
same VUI
HUM is easy to use and it makes since
Recall, “there has been no generally agreed-upon method of measuring usability, which makes it difficult to compare among different findings.” – Polkosky (SpeechTECH Magazine November/December 2005)
![Page 18: Holistic Usability Measure VUI Design: Philosophy and Practice.](https://reader036.fdocuments.in/reader036/viewer/2022062314/56649e895503460f94b8d93b/html5/thumbnails/18.jpg)
Thank You
http://www.HumanCenteredComputing.org