Keep In Touch: Channel, Expectation and Experience
-
Upload
rongrong-wang -
Category
Technology
-
view
492 -
download
0
description
Transcript of Keep In Touch: Channel, Expectation and Experience
![Page 1: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/1.jpg)
KEEP IN TOUCH: CHANNEL, EXPECTATION AND
EXPERIENCERongrong Wang, Virginia Tech
Francis Quek, Virginia Tech
Deborah Tatar, Virginia Tech
James K.S. Teh, National University of Singapore
Adrian D. Cheok, Keio University, Japan
CHI May 7, 2012
![Page 2: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/2.jpg)
“I’m Hugging You, Dad!”
![Page 3: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/3.jpg)
Was Paul Sending a Coded Message?
![Page 4: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/4.jpg)
![Page 5: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/5.jpg)
![Page 6: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/6.jpg)
Goal
To understand whether and how
remote touch in conjunction with speech
can influence the sense of connectedness
& emotional experience
![Page 7: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/7.jpg)
Touch
Touch & Emotion Communication
Valenced Emotions [Wolff 1963, Brossard 1968]
Emotion Amplifier [Knapp 1997]
Distinct Emotions [Hertenstein 2002]
Context Is Key [Jones 1985]
Touch Conveys Affect in An Immediate Non-symbolic Manner.
![Page 8: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/8.jpg)
Remote Touch
Digitally Mediated Touch
Focused on design
Either by design or user decision
Message Passing
Remote Touch Doesn’t Inherit The Immediacy of Real Touch?
![Page 9: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/9.jpg)
Armband
Shape Memory Alloy
![Page 10: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/10.jpg)
Story-Telling Study
Touch
Point
C1: Audio Only
C2: Audio + Touch Touch
Point
![Page 11: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/11.jpg)
Results shows
Significant reduction in sadness General trend toward greater joviality
Remote Touch can influence the affective components in communication
Wang, Rongrong and Quek, Francis, “Talk & Touch: Contextualize Remote Touch for Affective Conveyance”, TEI 2010
![Page 12: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/12.jpg)
Is the specific modality of touch important?
How does the context influence the effect of remote touch?
![Page 13: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/13.jpg)
Speech + Remote Touch Speech + Flashing Light
Type of Channel
![Page 14: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/14.jpg)
Expectation of Communicative Intent
“Communicative” Remote touch is intentionally sent by the story teller to express
her emotion states.
“Measurement” Remote touch is triggered by a measurement of the story
teller’s emotion state.
![Page 15: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/15.jpg)
Study Design: Channel x Experience
Speech +Additional Channel Speech Only
Channel
Expectation
Remote Touch Flashing Light
Base ConditionCommunicative Communicative Touch(CT)
Communicative Light (CL)
Measurement Measurement Touch(MT)
Measurement Light(ML)
![Page 16: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/16.jpg)
Study Procedure
Story Practice Session Pre-PANAS (Positive Affect Negative Affect Schedules) Story Post-PANAS Semi-Structured Interview
“How close do you feel to the storyteller? Please use the likert scale 1(not at all) to 7(extremely) to indicate.”
“Why do you feel connected this way?”
![Page 17: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/17.jpg)
Data Collection & Analysis
PANAS
Semi-Structured Interview
Audio Recorded (about 4 hours)
Transcribed (90 pages)
Open Coding
![Page 18: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/18.jpg)
Upper-Arm Squeeze Device
![Page 19: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/19.jpg)
Result 1: The Sense of Closeness
CT has the highest rating in the sense of closeness which is significantly higher than Base(p< 0.05)
One Way ANOVA
Communicative
Touch
MeasurementTouch
CommunicativeLight
MeasurementLight
Speech Only
![Page 20: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/20.jpg)
Result 2: Interaction Effect Between Channel and Expectation
Two-Way ANOVA on Closeness Variables
Channel x Expectation
Dependent Variable Closeness Rating
Communicative Measurement
0
1
2
3
4
5
6
5
43.625
4.4375
Interaction Plot
Touch
Flashing Light
A statistically significant
interaction effect (p<0.05)
![Page 21: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/21.jpg)
“Why do you feel close this way? ”
1. “The story is nice.”
2. “The way she told the story.” and “The way she carries her emotion in her voice. ”
3. “Own personal experience makes me feel close.”
4. “The squeeze feels like a personal physical contact and helps me visualize the activity. ” (only in CT and MT)
5. “The flashing light makes me feel more about her feelings.” (only in CL and ML)
6. “Not much in common.” and “I don’t like her story.”
![Page 22: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/22.jpg)
Positive Comments (Category 1~5)
# of positive comments in CT is significantly higher than that in the base condition (p<0.05)
2-Way ANOVA: significant interaction effect between channel and expectation (p<0.05)
![Page 23: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/23.jpg)
Result 3: CT leads to an intensified emotion experience
Changes in Negative Emotions
Changes in Sadness
Changes in Joviality
![Page 24: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/24.jpg)
Conclusion
Context is critical: Recipient’s expectation of communicative intent from storyteller
significantly impacts the sense of connectedness
Results support Immediacy of Touch Affect and connectedness are unlikely to be encoded symbolic
statements
Results support Uniqueness of Touch Difference in touch vs light channels (especially in the interaction
effect) suggest that touch is not easily replaced
![Page 25: Keep In Touch: Channel, Expectation and Experience](https://reader036.fdocuments.in/reader036/viewer/2022062514/5584a546d8b42a125c8b48fe/html5/thumbnails/25.jpg)
Acknowledgement
NSF Keio-NUS CUTE Center Center for HCI at Virginia Tech
Participants Steve Harrison