Accessibility Study of Touch and Gesture Interaction with Seniors
Gesture Interaction with Children for Education, Fitness, Games
-
Upload
obermanncenter -
Category
Education
-
view
99 -
download
1
Transcript of Gesture Interaction with Children for Education, Fitness, Games
![Page 1: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/1.jpg)
Lisa Anthony, PhD
Pictures from flickr.com by Creative Commons License
X equals 4 liters…
Turbo boost!
![Page 2: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/2.jpg)
Lisa Anthony, PhD
Pictures from flickr.com by Creative Commons License
X equals 4 liters…
Turbo boost!
![Page 3: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/3.jpg)
@drlanthony
Research Approach What are “natural user interactions”?
Why NUIs for Children
Touchscreen Interaction Projects
Future Research
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 3
![Page 4: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/4.jpg)
@drlanthony
Research Approach What are “natural user interactions”?
Why NUIs for Children
Touchscreen Interaction Projects
Future Research
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 4
![Page 5: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/5.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 5
VIDEO LINK: https://www.youtube.com/watch?v=6ECVHsUVuJg
![Page 6: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/6.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 6
speech
intent
vision
touch
gesture
motion
![Page 7: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/7.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 7
natural interaction doesn’t interfere with the user’s task
![Page 8: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/8.jpg)
@drlanthony
Understanding user needs and
capabilities
Developing new intelligent
algorithms
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 8
Design the algorithms informed by user behavior
Design the interfaces informed by tech strengths
![Page 9: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/9.jpg)
@drlanthony
Understanding user needs and
capabilities
Developing new intelligent
algorithms
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 9
Design the algorithms informed by user behavior
Design the interfaces informed by tech strengths
PsychologySocial scienceErgonomics…
Computer scienceMachine learningStatistics…
![Page 10: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/10.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 10
speech
intent
vision
touch
gesture
motion
![Page 11: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/11.jpg)
@drlanthony
Research Approach What are “natural user interactions”?
Why NUIs for Children
Touchscreen Interaction Projects
Future Research
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 11
![Page 12: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/12.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 12
kids are hands-on and learn by doing
![Page 13: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/13.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 13
kids apply real-world metaphors to technology
![Page 14: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/14.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 14
VIDEO LINK: https://www.youtube.com/watch?v=aXV-yaFmQNk
![Page 15: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/15.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 15
![Page 16: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/16.jpg)
@drlanthony
LETTERS SHAPES
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 16
A
E
Q
Δ
O
+drawn to scale
![Page 17: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/17.jpg)
@drlanthony
LETTERS SHAPES
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 17
A
E
Q
Δ
O
+drawn to scale
Adult Child Adult Child
![Page 18: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/18.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 18
X equals 4 liters…
![Page 19: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/19.jpg)
@drlanthony
Research Approach What are “natural user interactions”?
Why NUIs for Children
Touchscreen Interaction Projects
Future Research
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 19
![Page 20: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/20.jpg)
@drlanthony
1. Understanding how kids use touchscreens now
2. Understanding patterns in how kids make touch gestures
3. Understanding when and why current touch gesture recognition approaches don’t work
4. Designing and developing new algorithms for touch gestures
5. Designing and developing tools to help developers analyze input behavior patterns and choose the best gestures / recognizers for their specific context
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 20
![Page 21: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/21.jpg)
@drlanthony
“Mobile Touch and Gesture Interaction for Children”
https://mtagic.wordpress.com/
Funding support: NSF HCC Small NSF CISE #IIS-1218395/IIS-1433228 and IIS-1218664
Collaborators: Quincy Brown (Bowie State University)
Students from UMBC, Bowie State, and UF
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 21
Gesture
Touch cloud
![Page 22: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/22.jpg)
@drlanthony
4 studies with kids and adults (S1^, S2*, S3*, S4-ongoing) 49 kids (ages 7-17), 36 adults (ages 18+)
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 22
Study 2 setting
^ Brown, Q. and Anthony, L. 2012. Toward Comparing the Touchscreen Interaction Patterns of Kids and Adults. Proc. ACM SIGCHI Workshop on Educational Software, Interfaces and Technology (EIST’2012), Austin, TX, 05-06 May 2012.* Anthony, L., Brown, Q., Nias, J., Tate, B., and Mohan, S. 2012. Interaction and Recognition Challenges in Interpreting Children’s Touch and Gesture Input on Mobile Devices. Proc. ACM Conf. on Interactive Tabletops and Surfaces (ITS’2012), Cambridge, MA, 14 Nov 2012, p.225-234.
![Page 23: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/23.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 23
Touch TaskStudy 2
Gesture TaskStudy 2
![Page 24: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/24.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 24
Blue triangles: adultsRed squares: childrenBlack outline: target
Phone screen outline
![Page 25: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/25.jpg)
@drlanthony
1. Children miss more targets than adults**
2. Smallest targets most challenging*
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 25
** significant at the p<0.01 level * significant at the p<0.05 level
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very Small (0.125") Small (0.25") Medium (0.375") Large (0.5")
Av
era
ge
Pro
port
ion
of
Mis
ses
Target Size (inches)
Adults
Children
Average proportion of misses by target size for adults and children over all targets. Error bars show 95% confidence interval.
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Very Small (0.125") Small (0.25") Medium (0.375") Large (0.5")
Av
era
ge
Pro
port
ion
of
Mis
ses
Target Size (inches)
7 to 10
11 to 13
14 to 17
Adults 18+
Study 2a (ITS 2012) Study 2b (JPUC 2014)
![Page 26: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/26.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 26
Adults
Children
Study 1 (EIST 2012)
![Page 27: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/27.jpg)
@drlanthonyUnderstanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 27
No Visual Feedback(children)
Visual Feedback(children)
Study 2 (IDC 2013)
![Page 28: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/28.jpg)
@drlanthony
1. Kids make gestures differently than adults S1: kids make bigger gestures**
S1: kids make gestures with more strokes**
2. Kids’ gestures are recognized^less accurately than adults’**
S2: correlated to age**
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 28
** significant at the p<0.01 level
^ Anthony, L. and Wobbrock, J.O. 2010. A Lightweight Multistroke Recognizer for User Interface Prototypes. Proc. Graphics Interface (GI’2010), Ottawa, Canada, 02 Jun 2010, p.245-252.
0
1
2
3
4
5
6
<60% 60-65% 65-70% 70-75% 75-80% 80-85% 85-90% 90-95% 95-100%
Nu
mb
er
of P
art
icip
ants
Recognition Accuracy
Adults
Children
Histogram of recognition accuracy distribution for gestures drawn by children and by adults.
Study 2a (ITS 2012)
![Page 29: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/29.jpg)
@drlanthony
Demonstrate design recommendations in an open-source app as a tool for developers
Kids make gestures and touch targets differently than do adults: we can designand develop for this
Next steps: Understanding younger kids’ touch and
gesture patterns
Understanding and designing contextualizedinteractions
Developing child-specific recognizers
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 29
Design guidelines app
![Page 30: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/30.jpg)
@drlanthony
Kids’ gestures are recognized less accurately than adults’ by modern recognizers designed for adults Even when trained on kids gestures!
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 30
0.0%
10.0%
20.0%
30.0%
40.0%
50.0%
60.0%
70.0%
80.0%
90.0%
100.0%
7 to 10 11 to 13 14 to 17 Adults 18+
Re
cog
nit
ion
Acc
ura
cy
Participant Age GroupsUser-Independent TabletPC User-Independent $P
User-Dependent $N-Protractor User-Dependent $P
Recognition performance by age group for each of the four recognizer configurations tested.
Error bars indicate the 95% confidence interval.
Study 2b (JPUC 2014)Best performer on kids aged 7 to 10 is still only at 84%
![Page 31: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/31.jpg)
@drlanthony
Research Approach What are “natural user interactions”?
Why NUIs for Children
Touchscreen Interaction Projects
Future Research
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 31
![Page 32: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/32.jpg)
@drlanthony
1. Understanding how kids use whole-body interaction now
2. Understanding patterns in how kids move and make hand and body gestures
3. Understanding when and why current hand and body gesture recognition approaches don’t work
4. Designing and developing new algorithms for hand and body gestures
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 32
![Page 33: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/33.jpg)
@drlanthony
Education
Fitness
Games
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 33
Multimodal Algebra Equation Solving(PhD thesis, Carnegie Mellon, 2008)
![Page 34: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/34.jpg)
@drlanthony
Education
Fitness
Games
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 34
Image from PufferFish Ltd.
Investigating Public Engagement with Science(new project)
![Page 35: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/35.jpg)
@drlanthony
Education
Fitness
Games
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 35
Kinect Games for Exercisehttp://kinectforexercise.wordpress.com
![Page 36: Gesture Interaction with Children for Education, Fitness, Games](https://reader030.fdocuments.in/reader030/viewer/2022032617/55ad01a31a28ab36718b4756/html5/thumbnails/36.jpg)
@drlanthony
Lisa Anthony, PhD [email protected] @drlanthony
http://lisa-anthony.com and http://init.cise.ufl.edu
Understanding, Designing, and Developing Natural User Interactions for Children / Lisa Anthony, PhD 36
Acknowledgments: National Science Foundation, Pittsburgh Science of Learning Center, University of Florida, University of Maryland Baltimore County
speech
intent
vision
touch
gesture
motion