Handhelds in the Automobile: The Denali Navigation System Human Computer Interaction Institute...
24
Handhelds in the Automobile: The Denali Navigation System Human Computer Interaction Institute Human Computer Interaction Institute School of Computer Science School of Computer Science Carnegie Mellon University Carnegie Mellon University Brad A. Myers [email protected] http://www.cs.cmu.edu/ ~pebbles
Transcript of Handhelds in the Automobile: The Denali Navigation System Human Computer Interaction Institute...
Handhelds in the Automobile:The Denali Navigation SystemHandhelds in the Automobile:The Denali Navigation System
Human Computer Interaction Institute Human Computer Interaction Institute
School of Computer ScienceSchool of Computer Science
Carnegie Mellon UniversityCarnegie Mellon University
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
Brad Myers 2Talk for General Motors – 4/02/04
General Idea How can a handheld augment the
operation of an automobile? Not just using a PDA while in a car PDA augments and
interoperates with car Not for driving Examples:
Setting functions, controls Specifying destination for navigation systems
How can a handheld augment theoperation of an automobile?
Not just using a PDA while in a car PDA augments and
interoperates with car Not for driving Examples:
Setting functions, controls Specifying destination for navigation systems
Brad Myers 3Talk for General Motors – 4/02/04
Pebbles Project
This research is part of the Pebbles project Overall goal: investigate use of handhelds
at the same time as PCs and other computerized devices “Multi-Machine User Interfaces”
Assumption: handhelds will frequently be in close interactive communication with each other and other computers Wireless and wired technologies
This research is part of the Pebbles project Overall goal: investigate use of handhelds
at the same time as PCs and other computerized devices “Multi-Machine User Interfaces”
Assumption: handhelds will frequently be in close interactive communication with each other and other computers Wireless and wired technologies
Brad Myers 4Talk for General Motors – 4/02/04
Other Domains for Pebbles
Also created applications to study use of PDAs in: Classrooms Offices Meeting rooms Command Post of the Future Homes For the Handicapped
Also created applications to study use of PDAs in: Classrooms Offices Meeting rooms Command Post of the Future Homes For the Handicapped
Brad Myers 5Talk for General Motors – 4/02/04
Personal Universal Controller
Two-way communication Appliance describes its functions Personal Universal Controller then:
Automatically creates user interface Controls the appliance Displays feedback about appliance status
Two-way communication Appliance describes its functions Personal Universal Controller then:
Automatically creates user interface Controls the appliance Displays feedback about appliance status
Specifications
Control
Feedback
Brad Myers 6Talk for General Motors – 4/02/04
Current PUC Specification Language
XML Full documentation for the
specification language and protocol
Has been used to specify many appliances Stereo, MP3 player,
camera, VCR, room lights, elevator, etc.
XML Full documentation for the
specification language and protocol
Has been used to specify many appliances Stereo, MP3 player,
camera, VCR, room lights, elevator, etc.
Brad Myers 7Talk for General Motors – 4/02/04
Previously Reported
Modeling theGMC Yukon DenaliSUV Has a sophisticated
Driver InformationConsole system
Three-zone HVAC system LCD screen-based navigation system
Modeling theGMC Yukon DenaliSUV Has a sophisticated
Driver InformationConsole system
Three-zone HVAC system LCD screen-based navigation system
Brad Myers 8Talk for General Motors – 4/02/04
Simulator
Navigation System 50+ screens covering most navigation features
Limited direct interaction with the map (e.g. scrolling) Based on interacting with real device
Navigation System 50+ screens covering most navigation features
Limited direct interaction with the map (e.g. scrolling) Based on interacting with real device
Brad Myers 9Talk for General Motors – 4/02/04
Navigation Simulator, cont.
Brad Myers 10Talk for General Motors – 4/02/04
New Work
More parts of the Navigation Simulator Audio functions Various settings
Specification of the Navigation System’s functions in XML Exercises advanced features of PUC
specification language Automatic generation of (parts of) Navigation
System on PocketPCs
More parts of the Navigation Simulator Audio functions Various settings
Specification of the Navigation System’s functions in XML Exercises advanced features of PUC
specification language Automatic generation of (parts of) Navigation
System on PocketPCs
Brad Myers 11Talk for General Motors – 4/02/04
Future Work
Future Work on Simulator Simulate XM radio
Conduct a comparison user study Similar to our previous comparison study Measure time/errors for users using both the physical
unit and handheld remote control
Automatic generation with user consistency
Future Work on Simulator Simulate XM radio
Conduct a comparison user study Similar to our previous comparison study Measure time/errors for users using both the physical
unit and handheld remote control
Automatic generation with user consistency
Text Input Using EdgeWriteText Input Using EdgeWrite
Human Computer Interaction Institute Human Computer Interaction Institute
School of Computer ScienceSchool of Computer Science
Carnegie Mellon UniversityCarnegie Mellon University
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
Brad Myers 13Talk for General Motors – 4/02/04
Input while physically unstable
GM has sponsored research and patent on a new text entry technique called EdgeWrite™
First aimed at people with motor impairments Unable to make Graffiti or Jot gestures Physical edges provide physical stability
Instability might be a property of the environment, not just the person e.g., on a bus, while walking, or in a car
GM has sponsored research and patent on a new text entry technique called EdgeWrite™
First aimed at people with motor impairments Unable to make Graffiti or Jot gestures Physical edges provide physical stability
Instability might be a property of the environment, not just the person e.g., on a bus, while walking, or in a car
Brad Myers 14Talk for General Motors – 4/02/04
Stylus EdgeWrite™
Move along plastic edges inside square hole Recognition based on order corners are hit
OK if the path is jittery No need for:
Shift or caps lock Separate areas for
numbers and letters
Move along plastic edges inside square hole Recognition based on order corners are hit
OK if the path is jittery No need for:
Shift or caps lock Separate areas for
numbers and letters
Brad Myers 15Talk for General Motors – 4/02/04
Character Chart
Three subsets: Alphanumerics
(e.g., abc, 123)
Punctuation (e.g., !?#$*)
Extended characters (e.g., ®¶Øç)
144 characters with 306 forms
Three subsets: Alphanumerics
(e.g., abc, 123)
Punctuation (e.g., !?#$*)
Extended characters (e.g., ®¶Øç)
144 characters with 306 forms
Brad Myers 16Talk for General Motors – 4/02/04
Stylus EdgeWrite™ Results
After 15 minutes of practice, able-bodied novices: 18% more accurate than Graffiti About the same in speed (~7 WPM with each)
Note: Tasks included numbers and punctuation
Motor-impaired users were vastly more accurate 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s)
After 15 minutes of practice, able-bodied novices: 18% more accurate than Graffiti About the same in speed (~7 WPM with each)
Note: Tasks included numbers and punctuation
Motor-impaired users were vastly more accurate 22/72 in Graffiti, 68/72 in EdgeWrite (Parkinson’s)
Brad Myers 17Talk for General Motors – 4/02/04
Joystick EdgeWrite™
Could be useful for game consoles, mobile phones, or on power wheelchairs
Compared EdgeWrite to Date Stamp and Selection Keyboard
Tested with unmodified COTS joystick
Could be useful for game consoles, mobile phones, or on power wheelchairs
Compared EdgeWrite to Date Stamp and Selection Keyboard
Tested with unmodified COTS joystick
Brad Myers 18Talk for General Motors – 4/02/04
Touchpad EdgeWrite™
Use elevated edges around a Synaptics touchpad May be easier for people with motor impairments Maybe mount on the steering wheel or arm-rest?
Use elevated edges around a Synaptics touchpad May be easier for people with motor impairments Maybe mount on the steering wheel or arm-rest?
Brad Myers 19Talk for General Motors – 4/02/04
Touchpad Pilot Study
Two factors Output visible Touchpad visible
Touchpad visibility a complete non-factor!
Not seeing output doesn’t degrade performance very much
Two factors Output visible Touchpad visible
Touchpad visibility a complete non-factor!
Not seeing output doesn’t degrade performance very much
0
2
4
6
8
10
12
14
16
18
WPM Error %
Neither
Touchpad
Output
Both
One subject: 22.61 WPM (maximum)One subject: 22.61 WPM (maximum)
Brad Myers 20Talk for General Motors – 4/02/04
Using Joystick on Wheelchair
Custom hardware andsoftware to interfaceto commercial joystick
Informally evaluated with 7disabled power-wheelchair users 6 with Cerebral Palsy, 1 with Multiple Sclerosis Compared to on-screen keyboard and using
EdgeWrite on a touchpad
Custom hardware andsoftware to interfaceto commercial joystick
Informally evaluated with 7disabled power-wheelchair users 6 with Cerebral Palsy, 1 with Multiple Sclerosis Compared to on-screen keyboard and using
EdgeWrite on a touchpad
New!
Brad Myers 21Talk for General Motors – 4/02/04
Results
Touchpad worked betterthan wheelchair joystick
Touchpad worked betterthan wheelchair joystick
Brad Myers 22Talk for General Motors – 4/02/04
EdgeWrite.com
Download EdgeWrite software Find abridged and full character charts Find publications Order plastic templates See http://www.edgewrite.com/ or
http://www.cs.cmu.edu/~edgewrite/ Same web site
Download EdgeWrite software Find abridged and full character charts Find publications Order plastic templates See http://www.edgewrite.com/ or
http://www.cs.cmu.edu/~edgewrite/ Same web site
Brad Myers 23Talk for General Motors – 4/02/04
Future EdgeWrite™ work
Mouse/text disambiguation on touchpad Keyboard/mouse replacement for
people with disabilities Custom (non-commercial) joystick
implementation Cell phone implementation More user tests!
Mouse/text disambiguation on touchpad Keyboard/mouse replacement for
people with disabilities Custom (non-commercial) joystick
implementation Cell phone implementation More user tests!
Human Computer Interaction Institute Human Computer Interaction Institute
School of Computer ScienceSchool of Computer Science
Carnegie Mellon UniversityCarnegie Mellon University
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
Brad A. [email protected]
http://www.cs.cmu.edu/~pebbles
