Real-Time 3d Human Capture System _Sreevidhya@Students

8/8/2019 Real-Time 3d Human Capture System _Sreevidhya@Students

1/33

Real-time 3d human

capture system for

mixed-reality art and

entertainment


2/33

contents:-

Abstract

Index terms

Introduction

Hardware and system description

Software components

Magic land

User study of the magic land system

conclusion


3/33


4/33

INDEX TERMS

3d view point

Mixed reality

tangible interaction

Art

Entertainment


5/33


6/33

Hardware system description Hardware

System setup


7/33

Hardware


8/33

SYSTEM SETUP

In order to generate the novel view of the subject from any

angle/position of the virtual view point, the zoom level, position of

each dragonfly camera must be adjusted .

The system is very sensitive to the cameras intrinsic and extrinsicparameters .

Visual hull construction alg.

Both the Unibrain camera attached to the HMD and the dragonfly

cameras which capture the subject have to be calibrated.

Standard routines.

Standard routines from Intels OpenCV library.

Relative tranformation


9/33

SOFTWARE COMPONENTS

1.Overview

2.Image processing module

3.Synchronization 4.Results


10/33

OVERVIEW


11/33

IMAGE PROCESSING MODULE

The image processing module processes the raw captured image in

three steps:

1.Background subtraction.

2.Radial distortion compensation.

3.Image size reduction.


12/33

BACKGROUND SUBTRACTION

The result of visual hull construction in the rendering module largelydepends on the output of the background subtraction step.

This is more crucial step to determine the quality of the final 3d

model. Simple statistical method.

Modified method.

Main purpose of this method.

The pixel properties calculated here are chromaticity and brightness,

Which is obtained from a new model of pixel color. Each pixel is divided into 4 types, they are


13/33


14/33

These modifications reduce the complexity of the formula and quite

drastically increase the calculation speed ,but produce misclassified

pixels than original alg.


15/33

FILTERING

Morphological operators.


16/33

DATA SIZE FOR REAL TIME NETWORK

CONSTRAINTS

TO OPTIMIZE THE DATA WE CAN USE 2 METHODS.

1.Reducing the image size by only storing the smallest rectangular

region containing the foreground objects.

2.Using Bayer format


17/33

RESULTS


18/33

SYNCHRONIZATION


19/33

The purpose of synchronization


20/33

RENDERING


21/33

MAGICLAND


22/33


23/33

SYSTEM CONCEPT AND HARDWARE

COMPONENTS


24/33


25/33


26/33


27/33

SOFTWARE COMPONENTS


28/33

ARTISTIC INTENTION


29/33

FUTURE WORK


30/33

MAGIC LANDS RELATIONSHIP TO

MIXED REALITY GAMES


31/33


32/33

USER STUDY OF THE MAGIC LAND

SYSTEM Aim of this study

Design and procedures

Results of this study Conclusions of the user study


33/33

Real-Time 3d Human Capture System _Sreevidhya@Students

Documents

Transcript of Real-Time 3d Human Capture System _Sreevidhya@Students