The Coming Age of Empathic Computing
-
Upload
mark-billinghurst -
Category
Technology
-
view
992 -
download
0
Transcript of The Coming Age of Empathic Computing
![Page 1: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/1.jpg)
THE COMING AGE OF EMPATHIC COMPUTING
Mark Billinghurst [email protected]
June 2nd 2016
AWE 2016 Conference Santa Clara, USA
![Page 2: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/2.jpg)
![Page 3: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/3.jpg)
Current AR/VR/Wearable Technology
![Page 4: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/4.jpg)
Applications Enabled
• Gaming • Education • Health • Medicine • Training • Tourism • Etc
![Page 5: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/5.jpg)
Looking to the Future
![Page 6: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/6.jpg)
Empathy
“Seeing with the Eyes of another,
Listening with the Ears of another,
and Feeling with the Heart of another..”
Alfred Adler
![Page 7: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/7.jpg)
![Page 8: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/8.jpg)
Empathic Computing
1. Understanding: Systems that can understand your feelings and emotions
2. Experiencing: Systems that help you better experience the world of others
3. Sharing: Systems that help you better share the experience of others
Sensors
VR
AR
![Page 9: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/9.jpg)
1. Understanding: Affective Computing
• Ros Picard – MIT Media Lab • Systems that recognize emotion
![Page 10: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/10.jpg)
Example: Affectiva
https://www.youtube.com/watch?v=6QDMNPhMJI4
![Page 11: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/11.jpg)
2. Experiencing: Virtual Reality
"Virtual reality offers a whole different medium to tell stories that really connect people and create an empathic connection."
Nonny de la Peña http://www.emblematicgroup.com/
![Page 12: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/12.jpg)
Using VR for Empathy
• USC Project Syria (2014) • Experience of Terrorism • Project Homeless (2015)
• Experience of Homelessness
![Page 13: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/13.jpg)
Project Homeless
https://www.youtube.com/watch?time_continue=1&v=SSLG8auUZKc
![Page 14: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/14.jpg)
CHILDHOOD (Siggraph 2015)
• Kenji Suzuki, University of Tsukuba • What does it feel like to be a child? • VR display + moved cameras + hand restrictors
![Page 15: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/15.jpg)
CHILDHOOD Demo
https://www.youtube.com/watch?v=V3OghiKZxz4
![Page 16: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/16.jpg)
Sharing: Augmented Reality
Can we develop systems that allow us to share what we are seeing, hearing and feeling with others?
![Page 17: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/17.jpg)
Empathy Glasses (CHI 2016)
• Combine together eye-tracking, display, face expression • Impicit cues – eye gaze, face expression
+ +
Pupil Labs Epson BT-200 AffectiveWear
Masai, K., Sugimoto, M., Kunze, K., & Billinghurst, M. (2016, May). Empathy Glasses. In Proceedings of the 34th Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems. ACM.
![Page 18: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/18.jpg)
AffectiveWear – Emotion Glasses
• Photo sensors to recognize expression • User calibration • Machine learning • Recognizing 8 face expressions
![Page 19: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/19.jpg)
Empathy Glasses in Use
• Eye gaze pointer and remote pointing • Face expression display • In future integrated eye-tracking/display
![Page 20: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/20.jpg)
Empathy Glasses Demo
![Page 21: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/21.jpg)
Lessons Learned • Pointing really helps in remote collaboration
• Makes remote user feel more connected
• Gaze looks promising • Shows context of what person talking about • Establish shared understanding/awareness
• Face expression • Used as an implicit cue to show comprehension
• Limitations • Limited implicit cues • Task was a poor emotional trigger • AffectiveWear needs improvement
![Page 22: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/22.jpg)
Empathic VR Environments
• Player and Viewer • Viewer slaved to player
• Share emotional signals • Heart rate, GSR
• Remote affect measuring
![Page 23: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/23.jpg)
Demo: Empathic VR
![Page 24: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/24.jpg)
AR and VR for Empathic Computing • VR systems are ideal for trying experiences:
• Strong story telling medium • Provide total immersion/3D experience • Easy to change virtual body scale and representation
• AR systems are idea for live sharing: • Allow overlay on real world view/can share viewpoints • Support remote annotation/communication • Enhance real world task
![Page 25: The Coming Age of Empathic Computing](https://reader031.fdocuments.in/reader031/viewer/2022030402/588497081a28ab26058b5595/html5/thumbnails/25.jpg)
Conclusions • Trend towards Empathic Computing
• Understanding, Experiencing, Sharing
• AR/VR Enables Empathic Experiences • Changes perspective • Sharing space/experience • Supports annotation/communication
• Many directions for future research