Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne...
Transcript of Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne...
![Page 1: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/1.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Harnessing the motor system for
improved cognition
Leanne Chukoskie, Ph.D.
Asst. Research Scientist, Institute for Neural Computation
Asst. Science Director, Temporal Dynamics of Learning Center
Assoc. Director, Research for Autism and Development Lab
University of California, San Diego
![Page 2: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/2.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Brain and behavior develop together with
experience as a powerful teacher.
![Page 3: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/3.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
We are interested in learning how eye and body
movements come together to produce learning
opportunities in the world, or not, as the case
may be for some children.
![Page 4: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/4.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 5: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/5.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 6: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/6.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Attention
![Page 7: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/7.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Stjerna, et al, 2015
![Page 8: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/8.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
In the lab, we employ some useful (but rather dull)
tasks to assess attention and gaze control
• Basic saccade task (with gap and overlap
variants)
• Attention Network Task
• Posner-style cuing paradigm (with a
discrimination) to assess attention orienting
![Page 9: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/9.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Example of a “better” ANT task
from Ray Klein (Dalhousie)
![Page 10: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/10.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Methods
![Page 11: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/11.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Attention Orienting Task (E-task)
![Page 12: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/12.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
+* *
![Page 13: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/13.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
+
![Page 14: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/14.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
+
![Page 15: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/15.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 16: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/16.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Miller, Chukoskie, Zinni, Townsend and Trauner, 2014
Saccade control is atypical in ASD….
![Page 17: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/17.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Miller, Chukoskie, Zinni, Townsend and Trauner, 2014
….and may share underlying mechanism with
irregularity in finger tapping
![Page 18: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/18.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
How to remediate attention orienting?
![Page 19: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/19.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Intervention Computer
![Page 20: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/20.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 21: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/21.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 22: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/22.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Is there any transfer to
more “real world” tasks?
![Page 23: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/23.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Visuomotor Integration
![Page 24: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/24.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Driving simulator as mid-level outcome
measure
![Page 25: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/25.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
But what about realistic social interactions?
![Page 26: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/26.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Social gaze as a high-level
outcome measure
![Page 27: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/27.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
However, as you know, it isn’t just eye
movements that develop atypically. We used
a standardized motor battery (Florida Apraxia)
to characterize.
![Page 28: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/28.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 29: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/29.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 30: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/30.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 31: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/31.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 32: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/32.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 33: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/33.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
What good balance looks like
![Page 34: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/34.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
What poor balance looks like
![Page 35: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/35.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 36: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/36.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 37: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/37.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 38: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/38.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
![Page 39: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/39.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Cognitive benefits of gross motor
interventions?
• Currently, not much being done with special
populations, but…
• FITKids intervention from Charles Hillman
and colleagues shows expected fitness and
metabolic benefits, as well as cognitive.
• We are creating balanced-based
interventions for children with special needs
![Page 40: Harnessing the motor system for improved cognitionnews.ntu.edu.sg/rc-cradle/Documents/Leanne CHUKOSKIE.pdfNicole Suarez Shuying Yu Marlene Samano DVS/Kinect Camera Joe Snider, Ph.D.](https://reader036.fdocuments.in/reader036/viewer/2022071016/5fcfda340c9ec07f9718089e/html5/thumbnails/40.jpg)
Temporal Dynamics of Learning NTU Science of Learning Workshop
Many Thanks!!RADLab
Jeanne Townsend, Ph.D. – Director of RADLab
Marissa Westerfield, Ph.D. (walking MoCap)
Victor Minces, Ph.D. (social gaze analysis)
Nicole Suarez
Shuying Yu
Marlene Samano
DVS/Kinect Camera
Joe Snider, Ph.D.
Harinath Garudadri, Ph.D.
Alican Nalci
Alireza Khodamoradi
Nadir Weibel, Ph.D.
Steven Rick
Calvin Chan
Game design and build by:
Supported by:
NIMH R21/R33 MH096967