Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction...
Transcript of Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction...
![Page 1: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/1.jpg)
Wearable Computers As Wearable Computers As Intelligent AgentsIntelligent Agents
Thad StarnerContextual Computing Group
Georgia Tech &Swiss Federal Institute of Technology
(ETH)August 7, 2002
![Page 2: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/2.jpg)
BackgroundBackgroundAssistant Professor of Computing, Georgia TechFounder, Charmed TechnologiesFounder, MIT Wearable Computing ProjectIEEE ISWC and Wearable Information Systems TCEveryday use since 1993(earliest and longestnon-medical, everyday use)
![Page 3: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/3.jpg)
OutlineOutline
Wearable computing visions and definitionsQuestions about hardwareComparison to PDAs and laptopsNecessity of wearable agentsExample agents and interfaces
![Page 4: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/4.jpg)
HumanHuman--computer evolutioncomputer evolution
Mainframe -> mini -> PC -> wearableInitially lose on features– Less CPU capacity– Lower bus speed– Less disk storage
Gain on interface– Personalization– Interactivity
(Starner PhD 1999)
![Page 5: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/5.jpg)
Wearable Computing VisionWearable Computing VisionPocket or clothing based computingPeripherals distributed around the sensors and actuators of the body, connected wirelesslyRuns entire day Replace all portable consumer/computing electronics – MP3, DVD, PDA, laptop, medical devices, …
Video - Interact Atlanta
![Page 6: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/6.jpg)
Miniature HeadMiniature Head--up Displaysup DisplaysMicroOptical prescriptiondisplay eyeglasses
![Page 7: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/7.jpg)
TeleprompterTeleprompter
![Page 8: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/8.jpg)
KeyboardsKeyboards
Twiddler– Chording– In 5 min. alphabet– In 1 hr touch typing– Speed of 60 wpm
Half QWERTYEmbroider it in a jacket!
![Page 9: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/9.jpg)
CharmITCharmIT Wearable ComputerWearable Computer
(www.charmed.com)
266MHz Intel Pentium or 800MHz Transmeta Crusoe
![Page 10: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/10.jpg)
Everyday ApplicationsEveryday Applications
Used for similar applications as a modern PC, but not used like a PC:– Consumer devices: CD player, movies, cell phone,
pager, medical, e-mail, etc.– Instant messenger (zephyr)– Instant referencer (webster, google, thesaurus, etc.)– Remote monitoring (telnet)
Real benefit is in creating interfaces not previously possible with PCs and PDAs
![Page 11: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/11.jpg)
JustJust--inin--time Informationtime Information
Dictionary, thesaurus, books, experimental data…Web searches – googleInstant messaging – connect with hundreds of minds when neededWearable Agents
60 Minutes, Scientific American
![Page 12: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/12.jpg)
Questions About Hardware…?Questions About Hardware…?
How can I see with that thing in front of my eye?Eye strain?Isn’t it socially interruptive?Why do they cost so much?Isn’t that bad on your hands?Why do you tuck the display into your shirt pocket?…
![Page 13: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/13.jpg)
Wearable Computing as Interaction Wearable Computing as Interaction (Life)Style, Not Hardware(Life)Style, Not Hardware
Rhodes [Rhodes97]– Portable while operational– Enable hands-free or hands-limited use– Capable of getting the user’s attention even when not in
active use– Always “on”– Sense the user’s context in order to serve him better
Starner [Starner PhD 1999]– Persists and provides constant access– Senses and models context– Augments and Mediates– Interacts seamlessly
![Page 14: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/14.jpg)
Why not a PDA?Why not a PDA?Too much cognitive load– Augment, not replace task– Two hands, both eyes
Socially awkwardLow functionality– Input speed– Data storage– “Hot sync” effect– Applications
![Page 15: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/15.jpg)
Quick SurveyQuick Survey
How many people – Own one?– Have it with them?
If I was to schedule an appointment with you right now, how would it happen?
![Page 16: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/16.jpg)
Scheduling Device SurveyScheduling Device SurveyWhat sort of devices are used for scheduling/remembering appointments while mobile?What are the user’s perceptions of that device?Why do not more people use these devices/have them with them?
(Georgia Tech GVU TR #02-17 with Ben Wong and Robert Maguire co-authors; submitted to Trans. Computer Human Interface)
![Page 17: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/17.jpg)
Scheduling Device Survey (2)Scheduling Device Survey (2)
158 subjects– Georgia Tech student center– 90% students; 88% age 18-25; 70% male
What is your primary scheduling system while mobile?8 Likert scale questions on effectiveness, ease of use, speed, and reliablityOpen response questions
![Page 18: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/18.jpg)
What People Say They UseWhat People Say They Use
![Page 19: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/19.jpg)
SatisfactionSatisfaction
For every device, with moderately positive results, subjects thought that their device was – Appropriate– Sufficient– Somewhat necessary
![Page 20: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/20.jpg)
Satisfaction (2)Satisfaction (2)
For every system, subjects thought their system was– Easy to use– Fast to access
Curiously, many subjects admit to delaying entering appointments
![Page 21: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/21.jpg)
What Really HappensWhat Really Happens
After taking survey, subjects scheduled appointments with the experimenter– Could we meet sometime next Monday?– Could we schedule a time to meet in the second
week of February (three months in the future)?– Could we schedule a time to meet tomorrow?– Could we reschedule our appointment in
February from the 10th to the 11th?
![Page 22: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/22.jpg)
Videotaped InteractionsVideotaped Interactions
Scheduling device Subject view
![Page 23: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/23.jpg)
Actual Device UsageActual Device Usage
![Page 24: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/24.jpg)
What Subjects Say They UseWhat Subjects Say They Use
![Page 25: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/25.jpg)
DisuseDisuse
![Page 26: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/26.jpg)
Access Time for Scheduling Access Time for Scheduling SystemsSystems
![Page 27: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/27.jpg)
What Did We Learn?What Did We Learn?
People are bad at introspection:– Access time is actually significant– Often don’t use what they say they use
Once subjects learn a system, they make themselves (somewhat) satisfied with it– Hard to introduce new devices– Subjects suffer from shortcoming blindness
![Page 28: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/28.jpg)
Access Time vs. DisuseAccess Time vs. Disuse
![Page 29: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/29.jpg)
Access Time Predicts Use!Access Time Predicts Use!Related to the 2-second rule
If something takes longer than 2 seconds to do, its use will go down exponentially or linearly depending on the type of task
Informal verification in the literatureMultitasking (Miller)Web links (Shneiderman)Agents (Rhodes)
Implications for wireless service providers!
![Page 30: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/30.jpg)
Cognitive Load an Issue?Cognitive Load an Issue?
Scheduling appointments very interruptive; people tend not to multitaskSubjects in study showed evidence of delaying cognitive load of navigating interfaces until later (using memory or scratch paper as a stop-gap method)Brain imaging surveys– Show conflict between memory encoding and
multitasking with the phonological loop
(Schacter01)
![Page 31: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/31.jpg)
New HCI Question?New HCI Question?
How do we create interfaces where the computer task is NOT the primary one?– Conversations– Maintenance/Repair– Inspection– Touring physical reality
Similar domains– Automobile interfaces– Head-up displays/interfaces for aircraft
![Page 32: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/32.jpg)
Wearable Agents and ManWearable Agents and Man--machine Symbiosismachine Symbiosis
![Page 33: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/33.jpg)
How Not to Do It: The Jane How Not to Do It: The Jane ExperimentExperiment
Continuous audio-based agent– Inspired by Card’s “Ender’s Game”– Access to user’s e-mail– Internet search engines
Wizard of Oz experiment failed:– “Agent” could not respond quickly enough– Audio output was interruptive– Not enough context to be pro-active– Context could not accumulate due to experimental
conditions
![Page 34: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/34.jpg)
Session 2: Last TimeSession 2: Last TimeWearable computing as an interaction lifestyleAccess time predicts disuse2 second hypothesis
Evidence of high cognitive load when multiplexing some tasks– Anecdotal evidence with scheduling experiment– Brain imaging studies – phonological loop– Memory studies: distraction during encoding of
memories more harmful than during recallUsers naturally employ delaying tactics
![Page 35: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/35.jpg)
Last time (2)Last time (2)
HCI question: How do we make interfaces for situations where the computer is not the primary focus of attention?Must be careful of modality– Jane experiment suggests audio-only
information agent is not sufficient– Not enough context for pro-activity– Can be socially interruptive
![Page 36: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/36.jpg)
Necessity of Wearable AgentsNecessity of Wearable AgentsUser attention is the scarcest resourceCurrent interface devices and desktop metaphor is not appropriate– Hand-eye coordination of mouse/menu system distracts
from physical world– Can use physical world for “icons” instead of virtual
representations (e.g. ARToolkit)– Original “intellectual augmentation” work that led to
the SRI/Xerox/Apple WIMP system had to assume desktop due to physical limitation of the machines (Licklider, Engelbart, Kay, etc.)
![Page 37: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/37.jpg)
Perceptive Wearable AgentsPerceptive Wearable Agents
See what the user sees; hear what the user hearsUse new generation of sensors to recover contextMonitor interaction with traditional user interfaceExploit user’s “natural” behaviorsPro-actively perform tasks for the user
![Page 38: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/38.jpg)
The Remembrance AgentThe Remembrance Agent
Video- Scientific American Frontiers with Alan Alda
![Page 39: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/39.jpg)
Calendar Navigator AgentCalendar Navigator AgentInterface used in parallel during conversation when scheduling an appointmentUser’s speech performs dual roles: social communication and direction of interfaceMight someday be faster than human secretary– High resolution screen for feedback– Not restricted to linear presentation like speech
Only works because of– Limited vocabulary and grammar– Push-to-talk (variation)
(GVU Technical Report #02-17)
![Page 40: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/40.jpg)
Calendar Navigator AgentCalendar Navigator Agent
![Page 41: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/41.jpg)
“Can I see you next week sometime?”
![Page 42: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/42.jpg)
“Let me see if I’m free on the 24th”
![Page 43: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/43.jpg)
“Let me see if I’m free on the 31st”“Yes, 3pm seems like a good time”
![Page 44: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/44.jpg)
“OK, I’ll put “meet Maribeth” at 3pm in my calendar
![Page 45: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/45.jpg)
Dialog Tabs: Augmenting Dialog Tabs: Augmenting Conversation MemoryConversation Memory
Record user speechCreate small bars at corner of the screen whenever an “interesting” conversation heardTabs remind user to process the information later (delaying cognitive load)Use (limited) speech recognition to provide cues as to content of tab – similar to Whitaker’sSCANMail
![Page 46: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/46.jpg)
Dialog Tabs: Augmenting Dialog Tabs: Augmenting Conversational MemoryConversational Memory
![Page 47: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/47.jpg)
![Page 48: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/48.jpg)
![Page 49: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/49.jpg)
CharmBadgeCharmBadge
One of the simplest wearable computersExchange business card information between attendees at conferencesAllows attendees to sort conference contacts by length of conversationSimilarly, product information can be remembered and sorted based on interaction time
(www.charmed.com)
Demonstration
![Page 50: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/50.jpg)
Recognizing Social Recognizing Social EngagementEngagement
What if?: You never forgot a face/nameYou could recall details of prior interactionsYour cell phone never interrupted importantconversationsWe start by learning to recognize the beginning of important social situation (social engagement)
![Page 51: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/51.jpg)
Social Engagement DefinitionSocial Engagement Definition
– a location– a 1 ft to 7 ft social proximity – verbal display of intent to communicate
(greeting, assertion,etc...)– nonverbal display of intent to communicate
(gaze, handshake, eye fixation, locus of attention,etc…)
![Page 52: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/52.jpg)
For ExampleFor Example
![Page 53: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/53.jpg)
Can We Detect It?Can We Detect It?
Academic conference with 300+ participantsRecorded and annotated engagements of
wearer at conf.Extracted n 2-sec susbsets containing
engagement and other gesturesLearned 2 class HMM for enagement and
other gesture classes
(Singletary01 RATFG-RTS)
![Page 54: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/54.jpg)
ResultsResults
Train: Engagement 82.1%; Other 91.3%Test: Engagement 83.3%; Other 91.3%
EngagementStates
OtherStates
![Page 55: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/55.jpg)
DUCK!DUCK!
Towards a wearable perceptive interface without direct manipulation“Paintball” style game in a building with one-shot rubber dart gunsGoal: Create an agent that communicates team members’ positions and activities (gun at ready, aiming, and firing) using only on-body sensing
(Starner98 ISWC)
![Page 56: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/56.jpg)
DUCK! ApparatusDUCK! Apparatus
Forward-looking and downward-looking (at hands) camerasNot used: 360 degree camera, ambient and user microphones, dead reckoning system
![Page 57: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/57.jpg)
DUCK! Camera ViewsDUCK! Camera Views
video
![Page 58: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/58.jpg)
ResultsResults
Room-level location accuracy: 82%Action recognition (isolation): 86%
Extremely favorable reaction by expert players of simulated interface
![Page 59: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/59.jpg)
Representing Work FromRepresenting Work FromRicoh – Bradley Rhodes
MIT– Alex Pentland, Josh Weaver, Jeff Levine, Steve Mann
ETH– Bernt Schiele, Bastian Leibe
Georgia Tech– Grads: Ben Wong, Brad Singletary, Kent Lyons, Rob
Melby, Tracy Westeyn, Fleming Seay, and Helene Brashear
– Undergrads: Dan Ashbrook, Robert Maguire, Amy Hurst, and many, many “Janes.”
![Page 60: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/60.jpg)
SponsorsSponsors
Availability at Dagstuhl: ETH and DARPAMitsubishi, Accenture, Motorola, Intel, VisteonNational Science Foundation Career GrantNIDRRGeorgia Tech Broadband Institute
![Page 61: Wearable Computers As Intelligent Agents · 2002-08-15 · Wearable Computing as Interaction (Life)Style, Not Hardware zRhodes [Rhodes97] – Portable while operational – Enable](https://reader033.fdocuments.in/reader033/viewer/2022060303/5f08be667e708231d4238209/html5/thumbnails/61.jpg)
ResourcesResourcesCharmed Technologies (www.charmed.com)– Inexpensive wearables for prototyping
IEEE International Symposium on Wearable Computers (ISWC)– http://iswc.gatech.edu– 2002 Seattle, USA
IEEE Wearable Information Systems Technical Committee (computer.org)Home page: www.cc.gatech.edu/~thadResearch mailing list: [email protected]