Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums...

32
Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer Lance Chong Rose Marshack Lee Hendrickson Jim Crowell

Transcript of Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums...

Page 1: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

Application Framework for Canvas

A Virtual Reality Environment for Museums

Hank Kaczmarski Camille Goudeseune

Benjamin Schaeffer

Lance Chong

Rose Marshack

Lee Hendrickson

Jim Crowell

Page 2: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

Page 3: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

Canvas A Virtual Reality Environment for

Museums

Beckman Institute

Krannert Art Museum

University of Illinois, USAhttp://www.isl.uiuc.edu

Page 4: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

The Seedbed Initiative for Transdomain Creativity: Exploring Human Experience Through Art and Technology

Art is a touchstone of civilization, and as we stand at the dawn of a new age, called by some the era of “cultural computing,” the

possibilities for engaging the humanities with the fine and applied arts and with science and technology seem likely to surpass

anything yet imagined.

Page 5: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

PROJECT DRIVEN BY THE DESIRES OF THE

ELECTRONIC ARTISTS ON CAMPUS

Page 6: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

GOALS:

•USE EXISTING GALLERY SPACE

•MAKE ENVIRONMENT RECONFIGURABLE

•MINIMIZE UP-FRONT COSTS

•MINIMIZE LONG-TERM MAINTENANCE COSTS

•MAKE SYSTEM ARTIST-FRIENDLY

Page 7: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASThree walls

Six projectors

Obtuse-angled walls to allow

greater viewing space

Page 8: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASThree soft-screen

walls

(easily replaced)

Rear projection

Obtuse-angled walls to allow

greater viewing space

Page 9: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

DRIVEN BY

PC CLUSTER

CIRCULAR POLARIZED PASSIVE

STEREO

PROJECTION

Page 10: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

DRIVEN BY

PC CLUSTER

TWO SEPARATE NETWORK SWITCHES

ONE FOR GRAPHICS COMMUNICATION

ONE FOR DATA

Page 11: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

DRIVEN BY

PC CLUSTER

RENDER NODES

HAVE TWO-CHANNEL GRAPHICS CARDS

Page 12: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

GRAPHICS CARD FOR ONE WALL

DISPLAYS 2048X768

PIXEL IMAGE

ACROSS TWO

1024X768

VIDEO OUTPUTS

(ONE FOR EACH EYE)

Page 13: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASPOLARIZING FILTERS

CAN PERFORM EITHER LINEAR OR CIRCULAR

POLARIZATION

LINEAR IF ALL HORIZONTAL VIEWING

CIRCULAR IF HEAD-TILT IS DESIRABLE

Page 14: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

PASSIVE (LINEAR OR CIRCULAR

POLARIZED) STEREO

PROJECTION

MEANS

MUCH LESS

EXPENSIVE GLASSES

(25X LESS EXPENSIVE)

ACTIVE STEREO GLASSES

GLASSES ACTIVELY AFFECT VISION BY SHUTTERING LIQUID CRYSTAL LENSES UP TO 160 FIELDS PER SECOND -HIGH ON/OFF RATIO LEADS TOEXCELLENT DYNAMIC RANGETYPICALLY 30% TRANSMITTANCE

PASSIVE STEREO GLASSES

CONTAIN OPPOSITE POLARIZATION LENSESWORK CONTINUOUSLYHAVE NOTICABLE IMAGE “BLEED”ALSO 30% TRANSMITTANCE

Page 15: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

DRIVEN BY

PC CLUSTER

CIRCULAR POLARIZED STEREO

PROJECTION

Page 16: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

AFFORDABILITY:

•USE COMMODITY COMPUTERS

Page 17: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

SYZYGY:

A GRID-BASED OS FOR PC CLUSTER VIRTUAL

REALITY, TELECOLLABORATION

AND MULTIMEDIA SUPERCOMPUTING

Page 18: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASSYZYGY

MIDDLEWARE DRIVES 40

PROJECTOR POWER WALLS, Cubes,

CAVEs, SINGLE-WALL DISPLAYS AND

DESKTOP SYSTEMS IN ACTIVE AND

PASSIVE STEREO

Page 19: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASSYZYGY DOWNLOADS: http://www.isl.uiuc.edu/

1. szg-0.7: The source code for the Syzygy library plus sample applications and documentation.

2. py-szg-0.7: Python bindings for much of the Syzygy API.

3. pycube: Sample Python applications using Syzygy. Thanks George Francis and students!

4. vmat-0.7: A realtime physics library used in some of the applications in szgdemo.

5. szgdemo-0.7: Additional sample applications.

6. szgdata-0.7: Data for some of the sample applications. Due to space constraints, this cannot be everything. The remaining data is available upon request.

7. szg_app_template: A template project useful for

cross-platform C++ projects using Syzygy.

Page 20: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

ANY INPUT/OUTPUT DEVICE(S) THAT CAN (THROUGH THE USE

OF A COMPUTER) SEND NETWORKED

SOCKET INFORMATION TO THE SYSTEM WILL

WORK

Page 21: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASADAPT ACCEPTED

INTERACTION DEVICES FOR INTERACTION

USE WIRELESS COMMODITY GAMEPAD ALONE OR

ATTACH POSITION TRACKING SYSTEM OT IT AND/OR TO

EYEWEAR

POSITION TRACKING GREATLY INCREASES IMMERSIVE EFFECT BUT PERHAPS MORE GREATLY INCREASES SYSTEM COMPLEXITY, COST AND MAINTENANCE

Page 22: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

USE EXTREMELY SIMPLE AND

UNDERSTANDABLE (ON THE USER SIDE) INTERFACES AT THE

EXPENSE OF BEHIND-THE-SCENES COMPLEXITY

Page 23: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

CREATE DOCENT INTERFACE TO RUN

VISUALIZATION APPLICATIONS WIRELESSLY

Page 24: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

MAKE THE DOCENT INTERFACE AS SIMPLE AS POSSIBLE WITH WEB-BASED SCRIPTS TO KILL RUNNING PROCESSES AND START ALL NECESSARY PROCESSES FOR A NEW APPLICATION

Page 25: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASBEHIND-THE-SCENES:

GRAPHICS ENGINES HAVE ONE MONITOR

FOR EACH IMAGE

(2 PER COMPUTER/SCREEN)

PLUS NETWORKED CONSOLE TO PROGRAM WHILE ANOTHER AP IS

RUNNING

Page 26: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

OPERATOR

CONSOLE

MONITORS FOR

EACH PROJECTOR

PLUS

NON-DISPLAY

TERMINAL

Page 27: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

DEVELOP HUMAN INTERFACES TO

MEET THE NEEDS OF A NOISY

ENVIRONMENT

Page 28: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

INTEGRATE OPTICAL MOTION TRACKING

TECHNOLOGY

Page 29: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVASNO NEED TO BE A PROGRAMMER TO

GENERATE 3D IMAGES

SHAPECAM DOES IT FOR YOU AND

CREATES A .OBJ IMAGE FILE THAT

INTEGRATES SEAMLESSLY INTO

SYZYGY’S SOFTWARE INFRASTRUCTURE

Page 30: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

360 in CANVAS

MULTIDISCIPLINARY

TEAM OF ARTISTS, COMPUTER

PROGRAMMERS, ENGINEERS,

MUSEUM STAFF

Page 31: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

CANVAS

VOLUME RENDERING USING HARDWARE

ACCELERATION

UNIVERSITY OF SAO PAULO

Page 32: Integrated Systems Lab Application Framework for Canvas A Virtual Reality Environment for Museums Hank Kaczmarski Camille Goudeseune Benjamin Schaeffer.

Integrated Systems Lab

ACKNOWLEDGEMENTS

AUTHORS WISH TO THANK:

Kathleen Harleman, Krannert Art Museum, UIUCMarcello Knorich Zuffo, LSI, Universidade de Sao PauloLuciano Soares, LSI, Universidade de Sao Paulo