Research Exploration of Tangible User Interfaces
-
Upload
apurva-gupta -
Category
Design
-
view
355 -
download
3
description
Transcript of Research Exploration of Tangible User Interfaces
![Page 1: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/1.jpg)
Research investigation and exploration of
![Page 2: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/2.jpg)
Guided By: Keyur Sorathia, Asst. Prof
Apurva Gupta
10020509
Mehul Agarwal
10020525
![Page 3: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/3.jpg)
Scientific DiscoveryPhase 1 – Literature Survey
AdventurePhase 2 – Analysis, Identification of research
area & research question
EvilPhase 3 – Experimentation, Plan for next
semester
![Page 4: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/4.jpg)
ScientificDiscovery(Literature Research)
![Page 5: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/5.jpg)
Anything and everything which we can touch and feel
TANGIBLE
![Page 6: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/6.jpg)
“A Tangible User Interface gives physical form to digital
information and computation, salvaging the bits from the bottom
of the water, setting them afloat, and making them directly
manipulable with human hands.”
-by Hiroshi Ishii
![Page 7: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/7.jpg)
The TUI timelinepast works in TUI
Tangible Bits by IshiiTUI = Graspable Object +Ambient Media
1994 96 98 2000 02 04 06 08 10 12 2014
Graspable
Interfaces by
Fritzmaurice
Tokens, Containers, Tools by
Holmquist
Mapping physical object to digital
information.
Themes of TUI by
Eva H. et al.
Emphasis on person-product
interaction in Interaction
frogger
Another improved
definition by Koleva
et al.
Emerging framework for
TUI by Ullmer, Ishii
MCRpd. Object coupling wiith
digital rep. and digital info.
TAC Paradigm
Shaer et al.
Improvise mapping
Monograph by Eva
Hornecker et al.
![Page 8: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/8.jpg)
Classification Scheme
![Page 9: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/9.jpg)
TUI Domain and contextBroader domain of which project is a part of and the specific context in which it is used.
Iconic or Symbolic and Metaphors
Input Sensing TechnologyMicrocontroller, Camera Vision and RFID are 3 major technologies used for TUI projects.
Tangible ToolsTokens and Containers
Spatial, Relational or Constructive
Method of CouplingStatic or Dynamic Binding
Embodiment AxisEmbodiment Axis is relation between input and output device.
TUI SystemDirect-Manipulation, Behavioral Specifications or Communication Channels
Prototype (Evaluation and deployment)
InputDevice and Interaction Language used for providing Input
FeedbackDevice, modality and type of feedback
OutputDevice and modality used for providing output
![Page 10: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/10.jpg)
vProject Classification
![Page 11: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/11.jpg)
![Page 12: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/12.jpg)
Adventure(Critical Analysis)
![Page 13: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/13.jpg)
Analysis
![Page 14: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/14.jpg)
Chemicable Dirty Tangible Interfaces
TernTangible Rings
Slingshot
LumiTouch
Music Mixing Interface
Tangible Tiles
TUIs have been mostly used in field of
Entertainment, Play and Edutainment and Problem
Solving and Planning
![Page 15: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/15.jpg)
Ninja Tracks (Symbolic)
Iconic representation is increasing in projects and
whereas use of Symbolic representation is more or
less constant.
Chemicable Dirty Tangible Interfaces
Urp (Iconic)
![Page 16: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/16.jpg)
Tangible Rings (Spatial)
Siftables (Relational)
Tangible Triangles (Constructive)
Spatial properties are explored in many projects.
This can be also due to spatial advantage of TUIs
over GUI. But there are very few projects that use
all the three (Spatial, Relational and Cognitive)
capabilities of TUIs.
![Page 17: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/17.jpg)
Visual is more preferred medium for Output
whereas tactile is preferred more for feedback.
Almost 25% of projects read did not have any kind
of feedback.
Smell and taste were not chosen as feedback or
output modality in any of the papers read.
Slurp (Audio + Visual + Tactile)
Music Cubes (Audio)Tangible Rings (Visual)
UnitedPulse (Tactile)
CurlyBot (Visual + Tactile)
Haptic Cues (Audio + Tactile)
Music Mixing (Visual + Audio)
![Page 18: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/18.jpg)
Output- Visual followed by equal preference of
auditory and tactile. Feedback- Tactile, Visual and
then auditory.
Combination of Visual + Auditory was preferred for
Output while combination of Tactile + Auditory was
preferred for feedback.
Slurp (Audio + Visual + Tactile)
Music Cubes (Audio)Tangible Rings (Visual)
UnitedPulse (Tactile)
CurlyBot (Visual + Tactile)
Haptic Cues (Audio + Tactile)
Music Mixing (Visual + Audio)
![Page 19: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/19.jpg)
Research Areas
![Page 20: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/20.jpg)
Feedback modalities in TUI system
•
•
Slurp (Audio + Visual + Tactile) Tangible Rings (Visual) Haptic Cues (Audio + Tactile)
![Page 21: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/21.jpg)
Relation between no. of task and TUI handle (tool)
•
•
•
Ninja Tracks UrpTangible Tiles
![Page 22: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/22.jpg)
Impact and importance of gestures in Tangible Interfaces.
Slurp (Eyedropper Gesture) Tangible Rings (Lens Gesture) Music Cubes (Shake Gesture)
![Page 23: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/23.jpg)
GUI specific task (Copy-Paste or Undo) for Tangible Interfaces
![Page 24: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/24.jpg)
•
•
•
![Page 25: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/25.jpg)
How the TUI system differ for novice user or experienced user?
Can the same system perform easy to complex tasks or do we need to make modifications based on the level of experience of the user.
Comparing TUI and GUI on following parameters:
Computational, Work load, Task Complexity, Ergonomics, Entry threshold for the system, Contexts, Technological
literacy of the user (as defined by innovation adoption curve) For above mentioned
Is TUI better than GUI, or a hybrid solution makes a better option?
Input and output of a system could be co-located and coincident or spaced differently in time and space.
Study could be undertaken to understand how does concurrence of input/output space affects users perception, experience etc.
![Page 26: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/26.jpg)
Feedback modalities in TUI system
•
•
Slurp (Audio + Visual + Tactile) Tangible Rings (Visual) Haptic Cues (Audio + Tactile)
![Page 27: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/27.jpg)
Feedback and Output Modalities
![Page 28: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/28.jpg)
Visual is more preferred medium for Output
whereas tactile is preferred more for feedback.
Almost 25% of projects read did not have any kind
of feedback.
Smell and taste were not chosen as feedback or
output modality in any of the papers read.
Output- Visual followed by equal preference of
auditory and tactile. Feedback- Tactile, Visual and
then auditory.
Combination of Visual + Auditory was preferred for
Output while combination of Tactile + Auditory was
preferred for feedback.
Slurp (Audio + Visual + Tactile)
Music Cubes (Audio)Tangible Rings (Visual)
UnitedPulse (Tactile)
CurlyBot (Visual + Tactile)
Haptic Cues (Audio + Tactile)
Music Mixing (Visual + Audio)
![Page 29: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/29.jpg)
Statement From Research Papers
•
•
•
•
•
•
•
•
•
![Page 30: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/30.jpg)
Using Data obtained from analysis of projects
and Points from the theoretical papers
![Page 31: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/31.jpg)
Effectiveness of materiality as feedback modality over
tactile, audio, etc.
PneUI
Music CubesSlingshot
Inherent Feedback v/s Augmented Feedback-
How does user performance change?
Importance of Feedback for first time user v/s
experienced user?Music Mixing (Advanced User)Reactable
![Page 32: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/32.jpg)
vExamples of Material Feedback
![Page 33: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/33.jpg)
Checking if the rice is cooked
![Page 34: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/34.jpg)
Toothpaste
![Page 35: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/35.jpg)
Fresh Fruit
![Page 36: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/36.jpg)
Coconut
![Page 37: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/37.jpg)
Piggy Bank
![Page 38: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/38.jpg)
Batman’s Cape
![Page 39: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/39.jpg)
Current Research in Material modality
![Page 40: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/40.jpg)
InForm
![Page 41: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/41.jpg)
Invisible Helmet
![Page 42: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/42.jpg)
PneUI
![Page 43: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/43.jpg)
PneUI
![Page 44: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/44.jpg)
PneUI
![Page 45: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/45.jpg)
Jamming User Interface (Transparent Haptic Lens)
![Page 46: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/46.jpg)
Radical Atoms
![Page 47: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/47.jpg)
“Radical Atoms” is vision of human interactions with the future dynamic physical materials that
are transformable, conformable and informable.
Radical Atoms should fulfill the following three requirements:
• Transform its shape to reflect underlying computational state and user input;
• Conform to constraints imposed by the environment and user input; and
• Inform users of its transformational capabilities (dynamic affordances).
Radical Atoms
![Page 48: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/48.jpg)
Digital information has physical manifestation so that we can
interact with it.
Radical Atoms
![Page 49: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/49.jpg)
Evil(Experimentation)
![Page 50: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/50.jpg)
Hypothesis and Experimentation
![Page 51: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/51.jpg)
ExperimentationUsers
• New users / conditioned
users
• Illiterate-rural / Educated-
urban
• Age group
• Gender
• Past experience
Tests
• Effectiveness of change in material
properties as output modality over
audio/visual output modality
• Time taken for user to understand the
meaning of the output
• Effect of change in users (any point under
the users mentioned above)
• Effect of change in environment
(controlled / contextual)
Parameters
• Time of task completion
• Time between 2 tasks
• Preference of the user
• Error rates in task
execution
Tasks
• Tasks which justify
change in texture
• Task which is symbolic
Environment
• Contextual
deployment
• Controlled lab
![Page 52: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/52.jpg)
Material Properties
Color
Rigidity (If the object is stiff or soft)
Sound of object (wood and steel differ in sound)
Texture
Shape
• Dimensional (changing
length/breadth/height)
• Organic (cube ---> amoeba-like shape)
Smell of the object
Weight
State (Liquid/solid/gas)
Temperature
Colour Rigidity
TextureSound of object
Dimensional Change Organic Change
Smell of Object Weight
State Change Temperature
![Page 53: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/53.jpg)
Aim of the Experiment:1. Investigation of (feedback) influence on overall performance on
• Task completion time
• Error Rates
• Satisfaction
2. Understanding how well the user understands the task
• Task completion time
3. User preference of feedback modalities
Mode of the Experiment: 5 point Likert Scale
![Page 54: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/54.jpg)
Ho: Feedback has no influence on overall performance with respect to task
completion. [1]
H1: Feedback represented through visual modality has better performance
rates than feedback through physical manifestation . [2]
H2: Feedback represented through visual feedback will have a higher user
preference than physical manifestation. [2]
1. Hausen, D., Wagner, C., Boring, S., & Butz, A. (2013, April). Comparing modalities and feedback for peripheral interaction. In CHI'13
Extended Abstracts on Human Factors in Computing Systems (pp. 1263-1268). ACM.
2. Shimojo, S., & Shams, L. (2001). Sensory modalities are not separate modalities: plasticity and interactions. Current opinion in
neurobiology, 11(4), 505-509.
![Page 55: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/55.jpg)
Timeline
January: Development of Experiment
February: Experimentation
March-April: Analysis and Paper Publication
![Page 56: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/56.jpg)
Log on to:
medium.com/interaction-modalitiesto watch the whole show
![Page 57: Research Exploration of Tangible User Interfaces](https://reader033.fdocuments.in/reader033/viewer/2022051616/5539316455034680358b4970/html5/thumbnails/57.jpg)
References