Pen-based Interaction - Lecture 11 - Next Generation User Interfaces (WE-DINF-15756)
Next generation User interfaces
-
Upload
harshad-kt -
Category
Technology
-
view
109 -
download
0
description
Transcript of Next generation User interfaces
![Page 1: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/1.jpg)
NEXT
GENERATION
USER INTERFACES
HARSHAD K T
S5 MCA
Roll NO: DOALMCA013
NIELIT CALICUT
![Page 2: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/2.jpg)
Contents
Introduction
Technologies
Gesture Interfaces
Augmented Reality (AR)
Voice User Interface (VUI)
Tangible User Interface (TUI)
Conclusion
References
![Page 3: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/3.jpg)
INTRODUCTION
•User Interface
•Graphical User Interface (GUI)
User interfaces provide a means of
Input, allowing the users to manipulate a system
Output, allowing the system to indicate the effects of the
users' manipulation
![Page 4: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/4.jpg)
Here are some key features of
1.Gesture Interfaces
2.Augmented Reality (AR)
3.Voice User Interface (VUI)
4.Tangible User Interface
(TUI)
![Page 5: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/5.jpg)
Gesture Interfaces
Gesture recognition is a topic in computer
science interpreting human gestures via
mathematical algorithms.
Gestures can originate from any bodily motion
(commonly originate from the face or hand )
It enables humans to communicate with the machine
Gestures enabled applications provide interface to
interact with the system
![Page 6: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/6.jpg)
Gesture types
•Offline gestures : Those gestures that are processed
after the user interaction with the object. An example is
the gesture to activate a menu.
•Online gestures : Direct manipulation gestures. They
are used to scale or rotate a tangible object.
![Page 7: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/7.jpg)
Uses of gestures interfaces
1. Sign language recognition
2. Control through facial
gestures
3. Alternative computer
interfaces
4. Immersive game technology
5. Affective computing
6. Remote control
![Page 8: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/8.jpg)
Input devices
1. Wired gloves
2. Depth-aware cameras
3. Controller-based
gestures
4. Single camera
Data glove
Depth aware camera
![Page 9: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/9.jpg)
Sixth Sense Technology (Example system )
'Sixth Sense' is a wearable gestural interface that augments the
physical world around us with digital information and lets us
use natural hand gestures to interact with that information
Pranav mistry , inventor of the SixthSense
![Page 10: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/10.jpg)
•prototype is comprised of a Pocket Projector, a Mirror and
a Camera
•connected with the mobile computing device in the user’s
pocket.
•The software program processes the video stream data
captured by the camera and tracks the locations of
the colored markers
•Sixth Sense also supports multi-touch and multi-user
interaction
![Page 11: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/11.jpg)
Applications
Navigate a map
Multi-touch based systems
Zoom in, zoom out
Drawing application
Takes photos using “framing”
gestures
It augments the physical objects
![Page 12: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/12.jpg)
Taking photos with gestures
Augmented reality using 6th sense technologyNavigation, Zoom in / zoom
out
Devices used
![Page 13: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/13.jpg)
Augmented Reality (AR)
Augmented reality (AR) is a live, copy view of real-world
environment whose elements are augmented by computer-
generated sensory input such as sound, video, graphics
or GPS data
![Page 14: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/14.jpg)
Gaming Application
NavigationLive AU
AR enabled camera
![Page 15: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/15.jpg)
Devices Used
Hardware
Display
Head-mounted Display
Eyeglasses
Contact lenses
EyeTap
Handheld
Spatial Augmented
reality
Input devices
HMD
Contact lenses
EyeTap
![Page 16: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/16.jpg)
Applications
Architecture
Commerce
Education
Gaming
Medical
Military
NavigationEducation
Google Glass view
Commerce
Navigation
![Page 17: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/17.jpg)
Voice User Interface (VUI)
A voice–user interface (VUI) makes human
interaction with computers possible through a voice/speech
platform in order to initiate an automated service or process.
![Page 18: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/18.jpg)
Future Uses
1.Smart phone and PDA`s working
2.Helps the people who are slow in typing, (avoids straining
and Injuries )
3.Helps the handicapped people
4.Facilitate to create portable devices (with no keyboard, no
separation between content and keyboard on the touch
screen )
5.Reduce the devices half in size ( laptop computers ,
desktop, sliding mobile devices)
![Page 19: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/19.jpg)
1. The VUI must be sophisticated enough to distinguish
between the input commands, and background
conversation
2. It need highly sophisticated software in order to
accurately process and find or retrieve as per the
particular user's preferences
![Page 20: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/20.jpg)
Example gadget : Google glass
Samsung S-voice
![Page 21: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/21.jpg)
Understanding Speech Technology
Barge-In
Grammar
Tuning
Voice User Interface
VXML
The Voice XML Specification
The Voice XML Advantage
![Page 22: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/22.jpg)
Tangible User Interface
A tangible user interface (TUI) is a user interface in which
a person interacts with digital information through the
physical environment.
![Page 23: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/23.jpg)
Characteristics TUI
Physical representations are computationally coupled to
underlying digital information.
Physical representations with visible/ tangible interfaces for
interactive control.
Aware of physical objects through sensors and coupled to digital
representation
![Page 24: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/24.jpg)
Properties of tangible user interfaces
•space-multiplex both input and output
•concurrent access
•spatially aware (position, area, size… etc)
![Page 25: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/25.jpg)
Object recognition in TUI
![Page 26: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/26.jpg)
Surface computing
Surface computing enables user to interact directly with
the system
Without using keyboard and mouse
Features Direct interaction
Multi user experience
Multi touch
Object recognition
![Page 27: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/27.jpg)
Application
•Used in hotel, restaurants and retails stores
•In casinos (watch video , games,
navigation, ..etc)
•Digital image painting Advantages
Wireless communication
Time saving
New and improved learning
experience
Disadvantages
Not portable
Very Expansive
![Page 28: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/28.jpg)
Surface commuting systemsMicrosoft pixelsense
![Page 29: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/29.jpg)
CONCLUSION
Next Generation user interfaces are focused on real world
objects
The future electronic gadgets will be working on the above
discussed concepts
Many of these technologies are implemented now and some
of them are in developing stage
The trend changes in Electronics and IT will make effect
on future user interfaces also
![Page 30: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/30.jpg)
REFERENCES1. www.hongkiat.com/blog/next-gen-user-interface
2. www.hongkiat.com/blog/cool-futuristicconcept-gadgets-that-really-
inspires
3. en.wikipedia.org/wiki/Gesture_recognition
4. www.ted.com/talks/john_underkoffler_drive_3d_data_with_a_gesture
5. www.ted.com/talks/
pranav_mistry_the_thrilling_potential_of_sixthsense_technology
6. en.wikipedia.org/wiki/Voice_user_interface
7. mashable.com/category/augmented-reality
8. www.google.com/glass/start
![Page 31: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/31.jpg)
TED talks References
John Underkoffler Pranav Mistry Tomi Ahonen(Gestures interfaces) (Sixth sense technology) (Augmented
reality)
TED is a global set of conferences owned by the private non-profit Sapling
Foundation
( www.ted.com )
![Page 32: Next generation User interfaces](https://reader036.fdocuments.in/reader036/viewer/2022062511/54c73f604a79593f708b45d0/html5/thumbnails/32.jpg)
Thank you