Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane...
-
Upload
lynne-stokes -
Category
Documents
-
view
216 -
download
2
Transcript of Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane...
![Page 1: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/1.jpg)
Multimodal Annotation Tool for Challenging Behaviors
in People with Autism Spectrum Disorders
Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt, Rosalind W. Picard, Matthew S.
Goodwin1
MIT Media Lab 1Northeastern University
![Page 2: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/2.jpg)
![Page 3: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/3.jpg)
Relevant Work• Pen & paper
o Flexible
o Prone to errors
o Slow
• Other tools for annotations
o CareLog (Hayes et al. 2008)
o Baby Steps (Kientz et al. 2009)
o SymTrend, AutismTrack,…
o Annotation Apps
![Page 4: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/4.jpg)
Application
http://affect.media.mit.edu/projectpages/ama/
![Page 5: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/5.jpg)
http://affect.media.mit.edu/projectpages/ama/
Application: Events Summary
![Page 6: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/6.jpg)
http://affect.media.mit.edu/projectpages/ama/
Application: Configuration
![Page 7: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/7.jpg)
•Portable
•Scalable
•Inexpensive
•Customizable
•Reliable
Application: Benefits
![Page 8: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/8.jpg)
Groden Center 8 class teachers (6 females, ages 23-37, 2 males, ages 32,
52)
previous experience in behavior assessments using pen/paper annotations
familiar with the use of tablet computers
User Study
![Page 9: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/9.jpg)
Instructions on how to use the system
Customize activities and behavior settings for each student with the guidance of the instructor
Annotate students’ activities and challenging behaviors in their classroom for half day
Evaluate usability of application: SUS, 7-point Likert usability questionnaire, open-ended questions.
User Study
![Page 10: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/10.jpg)
StronglyDisagree
StronglyAgree
System Usability Scale - Score: 80.3 (std: 11)
(Brooke, 1996)
Results
![Page 11: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/11.jpg)
StronglyDisagree
StronglyAgree
Results
![Page 12: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/12.jpg)
No quantifiable impact on children's behaviors or school performance.
One child especially enjoyed using the tablet in conjunction with the teacher.
A smaller device could be a better option:
“Change the size of the tablet to one possibly a little bigger than a smart phone so staff can put it in a pocket if need to respond to student with two hands free.”
Other Findings
![Page 13: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/13.jpg)
Future Work•More systematic comparison
between pen & paper method and the application
•Inclusion of wireless biosensors
•Infrastructure to share and visualize data
![Page 14: Multimodal Annotation Tool for Challenging Behaviors in People with Autism Spectrum Disorders Akane Sano, Javier Hernandez, Jean Deprey, Micah Eckhardt,](https://reader030.fdocuments.in/reader030/viewer/2022032805/56649ee15503460f94bf1d1d/html5/thumbnails/14.jpg)
•Mobile tool to easily capture and annotate challenging behaviors
•Application available online
•Potential benefits
1) Connecting stakeholders
2) Data-driven characterization of ASD
3) More personalized behavioral interventions
http://affect.media.mit.edu/projectpages/ama/
Conclusions