A multimodal interaction framework for pervasive game applications

14
By For Documentation and Downloads Visit

Transcript of A multimodal interaction framework for pervasive game applications

Page 1: A   multimodal   interaction   framework   for pervasive   game   applications

By

For Documentation and Downloads Visit

Page 2: A   multimodal   interaction   framework   for pervasive   game   applications

Introduction:What is STARS?A platform for developing computer augmented board

games that integrate mobile devices with an interactive table.

Augment traditional board games with computing functionality.

Consists of a specialized hardware setup and an interaction framework that dynamically couples mobile and stationary i/p and o/p devices with the game table.

Page 3: A   multimodal   interaction   framework   for pervasive   game   applications

Stars Setup-Device ComponentsComponents that are integrated into the

STARS session are:

TableWall DisplayPersonal Digital Assistants.Audio Devices

Page 4: A   multimodal   interaction   framework   for pervasive   game   applications

TABLE

Game board is displayed on its surface.Tracked by an overhead camera.e.g: InteracTable-a Roomware component.

Page 5: A   multimodal   interaction   framework   for pervasive   game   applications

Wall Display

Shows game relevant public information.Videos or animations can be played-triggered either by a player or by the logic of STARS. Consists Dynawall

Page 6: A   multimodal   interaction   framework   for pervasive   game   applications

Personal Digital Assistants

Used for taking private notes and for administering private data.

Page 7: A   multimodal   interaction   framework   for pervasive   game   applications

Personal Digital AssistantsThe second use for

the PDAs are private communication

channels that allow both a STARS game logic and the players to

send private messages to other players

Page 8: A   multimodal   interaction   framework   for pervasive   game   applications

Audio Devices

Players wear ear phones or uses loud speakers.

Page 9: A   multimodal   interaction   framework   for pervasive   game   applications

STARS S/W Architecture

Page 10: A   multimodal   interaction   framework   for pervasive   game   applications

POOL OF MODES-I/P

Page 11: A   multimodal   interaction   framework   for pervasive   game   applications

POOL OF MODES-O/P

Page 12: A   multimodal   interaction   framework   for pervasive   game   applications

ConclusionUser ExperiencesKey Features:

Easy to include new devices and modes.Private Communication over audio or PDA

Future Enhancements:Scope could be augmented to include other

domains such as engineering tasks , chemistry or shared Architectural design.

Page 13: A   multimodal   interaction   framework   for pervasive   game   applications
Page 14: A   multimodal   interaction   framework   for pervasive   game   applications