Multi-Camera Head Tracking for the Varrier Autostereo Display

1
Problem Statement and Motivation Key Achievements and Future Goals Technical Approach Multi-Camera Head Tracking for the Varrier Autostereo Display Jason Leigh, Luc Renambot, Javier Girado, Andrew Johnson, Dan Sandin, Tom DeFanti, Electronic Visualization Laboratory, Dept. of Computer Science Office of Naval Research and National Science Foundation High resolution stereoscopic computer graphics is crucial to understanding abstract structures in geoscience and bioscience. Such displays do not currently exist on the market. A key factor in enabling widespread adoption of stereo in the future is to create stereoscopic displays that can be viewed without wearing special glasses. The Varrier system prototypes this capability using arrays of LCD panels mounted with black line screens. Precise realtime, low-latency, head tracking is required to ensure perfect stereoscopic effect. A first prototype of a 7x5 LCD Varrier system exists at UIC and has been tested with a single camera head tracking system with good results. A small 2x2 system will be deployed at the Technology Research Education and Commercialization Center (TRECC) in DuPage County, Illinois. Next generation capability will have increased frame rate, high resolution and lower latency for tracking. Next generation system will use an array of cameras to allow full resolution coverage of a wide viewing area for supporting a full-sized 7x5 Varrier system. This system will be deployed at the ACCESS center in Washington D.C. This was demonstrated at the iGrid 2005 and SC2005 conferences in the Fall of 2005. By placing a black line screen in front of commodity LCD panels and applying the correct graphical transformations, one can create stereoscopic computer graphics which can be viewed without wearing specialized glasses. A cluster of 35 computers with high-end graphics cards is used to drive the pictured 7x5 panels. A high speed neural network-based facial recognition system is used to track the viewer so that the correct perspective is drawn relative to the viewer’s viewpoint. The facial recognition system also allows the system to lock onto a single user, even when some one else steps in front of the display. 7x5 LCD panels covered with a black line screen overlay to achieve an autostereoscopic effect.

description

Multi-Camera Head Tracking for the Varrier Autostereo Display. Jason Leigh, Luc Renambot , Javier Girado , Andrew Johnson, Dan Sandin , Tom DeFanti , Electronic Visualization Laboratory, Dept. of Computer Science Office of Naval Research and National Science Foundation. - PowerPoint PPT Presentation

Transcript of Multi-Camera Head Tracking for the Varrier Autostereo Display

Page 1: Multi-Camera Head Tracking for the  Varrier Autostereo  Display

Problem Statement and Motivation

Key Achievements and Future GoalsTechnical Approach

Multi-Camera Head Tracking for the Varrier Autostereo DisplayJason Leigh, Luc Renambot, Javier Girado, Andrew Johnson, Dan Sandin, Tom DeFanti,

Electronic Visualization Laboratory, Dept. of Computer ScienceOffice of Naval Research and National Science Foundation

High resolution stereoscopic computer graphics is crucial to understanding abstract structures in geoscience and bioscience. Such displays do not currently exist on the market. A key factor in enabling widespread adoption of stereo in the future is to create stereoscopic displays that can be viewed without wearing special glasses. The Varrier system prototypes this capability using arrays of LCD panels mounted with black line screens. Precise realtime, low-latency, head tracking is required to ensure perfect stereoscopic effect.

• A first prototype of a 7x5 LCD Varrier system exists at UIC and has been tested with a single camera head tracking system with good results. A small 2x2 system will be deployed at the Technology Research Education and Commercialization Center (TRECC) in DuPage County, Illinois.

• Next generation capability will have increased frame rate, high resolution and lower latency for tracking.

• Next generation system will use an array of cameras to allow full resolution coverage of a wide viewing area for supporting a full-sized 7x5 Varrier system. This system will be deployed at the ACCESS center in Washington D.C.

• This was demonstrated at the iGrid 2005 and SC2005 conferences in the Fall of 2005.

• By placing a black line screen in front of commodity LCD panels and applying the correct graphical transformations, one can create stereoscopic computer graphics which can be viewed without wearing specialized glasses.

• A cluster of 35 computers with high-end graphics cards is used to drive the pictured 7x5 panels.

• A high speed neural network-based facial recognition system is used to track the viewer so that the correct perspective is drawn relative to the viewer’s viewpoint. The facial recognition system also allows the system to lock onto a single user, even when some one else steps in front of the display.

7x5 LCD panels covered with a black line screen overlay to achieve an autostereoscopic effect.