CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR....
Transcript of CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR....
![Page 1: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/1.jpg)
CS591: HUMAN COMPUTER
INTERACTION
LITERATURE SURVEY
VIRTUAL REALITY – A HUMAN COMPUTER INTERFACE
Shiv Sankar1 Shoubhik Debnath1
1 Undergraduates, CSE 3rd Year,
Indian Institute of Technology Mandi
![Page 2: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/2.jpg)
VIRTUAL REALITY – WHAT IS VR?
PERCEPTION
TYPES OF VR
TECHNOLOGIES IN VR
ARCHITECTURE OF VR SYSTEMS
ONGOING TRENDS
FUTURE SCOPES
SUMMARY
TOUR GUIDE
![Page 3: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/3.jpg)
"REALITY IS 80 MILLION POLYGONS PER SECOND" - COMPUTER PROGRAMMER, ALVY
RAY SMITH
VIRTUAL REALITY
![Page 4: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/4.jpg)
THE COMPUTER-GENERATED SIMULATION OF A THREE-DIMENSIONAL
IMAGE OR ENVIRONMENT THAT CAN BE INTERACTED WITH IN A
SEEMINGLY REAL OR PHYSICAL WAY BY A PERSON USING SPECIAL
ELECTRONIC EQUIPMENT, SUCH AS A HELMET WITH A SCREEN INSIDE OR
GLOVES FITTED WITH SENSORS
VIRTUAL REALITY
![Page 5: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/5.jpg)
PERCEPTION : THE ABILITY TO SEE, HEAR, OR BECOME AWARE OF
SOMETHING THROUGH THE SENSES – “ THE NORMAL LIMITS TO
HUMAN PERCEPTION ”
ACCORDING TO BRENDA LAUREL, "REALITY HAS ALWAYS BEEN TOO SMALL
FOR THE HUMAN IMAGINATION. WE'RE ALWAYS TRYING TO TRANSCEND"
(QUOTED IN MCCARTHY, 1993)
DO WE ACTUALLY SEE WHAT IS REAL?
![Page 6: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/6.jpg)
TYPES OF VR SYSTEM
�Windows on World (WoW)
• Also called Desktop VR.
�Immersive VR
• The user has no visual contact with the physical word.
• Often equipped with a Head Mounted Display (HMD).
�Mixed Reality(Augmented Reality)
• The seamless merging of real space and virtual space.
• Integrate the computer-generated virtual objects into the physical world which
become in a sense an equal part of our natural environment.
6
![Page 7: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/7.jpg)
TYPES OF VR SYSTEM
�Tele-presence
• A variation of visualizing complete computer generated worlds.
• Links remote sensors in the real world with the senses of a human operator.
The remote sensors might be located on a robot. Useful for performing
operations in dangerous environments.
7
![Page 8: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/8.jpg)
TYPES OF VR SYSTEM
�Distributed VR
8
![Page 9: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/9.jpg)
“IF AN INTERFACE IS DEFINED AS WHERE TWO DIFFERENT WORLDS MEET,
IT WOULD APPEAR THAT THE MORE DISSIMILAR THE TWO WORLDS THE
GREATER THE NEED FOR A WELL-DESIGNED INTERFACE.”
THE TECHNOLOGY OF VR
![Page 10: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/10.jpg)
TECHNOLOGIES OF VR
�Head-Mounted Display (HMD)
− A Helmet or a face mask providing the visual and auditory displays.
− Use LCD or CRT to display stereo images.
− May include built-in head-tracker and stereo headphones
10
![Page 11: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/11.jpg)
� Binocular Omni-Orientation Monitor (BOOM)
− Head-coupled stereoscopic display device.
− Uses CRT to provide high-resolution display.
− Convenient to use.
− Fast and accurate built-in tracking.
11
TECHNOLOGIES OF VR
![Page 12: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/12.jpg)
�Cave Automatic Virtual Environment (CAVE)
− Provides the illusion of immersion by projecting stereo images on the walls and floor of a room-sized cube.
− A head tracking system continuously adjust the stereo projection to the current position of the leading viewer.
12
TECHNOLOGIES OF VR
![Page 13: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/13.jpg)
�Data Glove
• Outfitted with sensors on the fingers as well as an overall position/orientation
tracking equipment.
• Enables natural interaction with virtual objects by hand gesture recognition.
13
TECHNOLOGIES OF VR
![Page 14: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/14.jpg)
�Control Devices
• Replication on mouse of 2D-VR
• Control virtual objects in 3 dimensions.
14
TECHNOLOGIES OF VR
![Page 15: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/15.jpg)
� Input Processor,
� Simulation Processor,
� Rendering Processor and
� World Database.
15
Input
Processor
Rendering
Processor
World Database
Simulation
Processor
visual,
auditory,
haptic,
touch6
Position &
Orientation
ARCHITECTURE OF VR SYSTEM
![Page 16: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/16.jpg)
�Input Processor
• Control the devices used to input information to the computer. The object is to get the coordinate data to the rest of the system with minimal lag time.
• Keyboard, mouse, 3D position trackers, a voice recognition system, etc.
� Simulation Processor
• Core of a VR system.
• Takes the user inputs along with any tasks programmed into the world and determine the actions that will take place in the virtual world.
� Rendering Processor
• Create the sensations that are output to the user.
• Separate rendering processes are used for visual, auditory, haptic and other sensory systems. Each renderer take a description of the world stat from the simulation process or derive it directly from the World Database for each time step.
� World Database (World Description Files)
• Store the objects that inhabit the world, scripts that describe actions of those objects.
16
ARCHITECTURE OF VR SYSTEM
![Page 17: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/17.jpg)
MILITARY APPLICATIONS:
FLIGHT TRAINING
MISSILE LAUNCHES
WAR SIMULATION
COMMERCIAL APPLICATIONS:
ARCHITECTURE
MEDICAL PURPOSES
HEALTH CLUBS
VIRTUAL SETS
SOCIAL USES
TEXT BASED VIRTUAL REALITY
EDUCATION
VIRTUAL SEX
ONGOING TRENDS
![Page 18: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/18.jpg)
EXPOSURE THERAPY FOR ACROPHOBIA
Virtual Elevator
![Page 19: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/19.jpg)
FUTURE OF VR
• Education: Distributed VR.
• Training: In military training, parachuting, enemy combat, weapons training
and hand-to-hand combat can be simulated through virtual training.
• Sports: Studies on athletes have shown that imagining moves on the field are
80-85% of actual physical training which indeed is a good sign when it comes
in terms of virtual reality.
• Inter-personal communication: Experts have long said that 80 to 90-percent
of all communication is non-verbal. Future virtual reality is expected help
bridge this gap in that if we were to meet someone in a virtual space.
![Page 20: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/20.jpg)
THE TEAM THINKS
Being in an academic institute and surrounded by the competitive world where
students are struggling to get into companies, there is a great need to create a
virtual environment where students can prepare for interviews by consulting
experienced interviewers virtually. Such simulated environment not only prepares
the students but also helps the company to conduct interviews and thereby
prevent them from travelling to different colleges for campus recruitments. Overall,
this is a good way of improving inter-personal communication and thereby
reducing misunderstandings while communicating.
![Page 21: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/21.jpg)
21
• Simulator sickness
• Low-fidelity
• Expensive
• Lack of integration between application packages
• High-fidelity system
• Cost-saving
• Collaborative
• High-level contact between participants in distributed VR
CURRENT PROBLEMS & FUTURE WORK
![Page 22: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/22.jpg)
22
IMMERSIVE VIRTUAL REALITY TECHNOLOGY
![Page 23: CS591: HUMAN COMPUTER INTERACTION - PradiptaBiswas · FUTURE OF VR • Education: Distributed VR. • Training: In military training, parachuting, enemy combat, weapons training and](https://reader036.fdocuments.in/reader036/viewer/2022081522/5edfd6f4ad6a402d666b239b/html5/thumbnails/23.jpg)
SUMMARY
�Visualization of complicated, large data is helpful for understanding and analysis.
�VR offers us a new way to interact with computer.
�VR enables us to experience the virtual world that is impossible in real world.
�VR is changing our life, eventually VR will increasingly become a part of our life.
23