3D VIDEO CODING & STREAMING REAL-TIME OF HD/3D VIDEO CONTENT

PhD Student: Valentina Pullano

Cycle: XXV

Supervisors: Prof. G.E. Corazza, Prof. A. Vanelli-Coralli

OVERVIEW

3D TECHNOLOGIES: STEREOSCOPY DISPLAY AND GLASSES Steroscopy: phenomenon at the base of 3D

vision Stereoscopy is any technique capable of

creating the illusion of depth in an image Stereoscopic phenomenon was first understod

by Euclid in 208 b.C. Steoreoscope: Sir Charles Wheatstone in 1838 Etimology: stereos (stiff,solid) and scopos

(looking) 3D Technologies: steroscopic &

autostereoscopic Display, Passive and Active 3D Glasses, 3D phones

3D VIDEO CONTENT

Stereoscopic Content 2D+Depth Geometric modeling

3D VIDEO CODING

There are many methods for the compression of 3D videos that can be classified in three macro categories:

Conventional Stereo Video Coding Stereoscopic content Video plus Depth Coding 2D plus Depth Content Multiview Video Coding (MVC)

Our objective is to achieve an efficient and reliable transmission of 3D videos over noisy channels Joint Source and Channel Coding (JSSC)

Two main aspects have to be considered:

1) Redundancy reduction Compression

2) Error protection Channel Coding

The Joint Source Channel Coding (JSCC) is the encoding of a redundant information source for transmission over a noisy channel, and the corresponding decoding, using a single code instead of the more conventional steps of source coding followed by channel coding

ONGOING PROJECTS

3DPhone (Jan.2008- Jan.2011) Project funded under the FP7.

The project aims to develop in 3D all fundamental functions of the phone media display, user interface (UI), personal information management (PIM) applications

Mobile 3DTV (Jan.2008- Ongoing) Project funded under the FP7.

The primary goal is to demonstrate the viability of the new technology of mobile 3DTV.

FTV Free View-Point TV (July 2007- July 2010) Japanese project.

The main idea is that the users can arbitrary choose a new viewpoint to view the scene from and to be in full control of changing it at anytime.

SkyMedia (Jan.2010-June 2012) Project funded under the FP7.

The main objective is to explore, design, and demonstrate a novel multimedia end-to-end architecture that can provide unique immersive media experiences to audiences during live events and to provide a system architecture scalable, flexible and easy to manage.

SKYMEDIA PROJECT

REAL TIME STREAMING VIDEO

Real-time Multimedia: Real time transport of live audio/video or stored audio/video content. The video content does not need to be downloaded in full, but it is played out while parts of the content are being received and decoded.Video streaming has very stringent constraints in terms of bandwidth, delay jitter and loss.

CHALLENGES & PROPOSED TOPIC

3D Video Coding and Multimedia Streaming Content leave many open issues; our predominant challenges are:

Determine efficient and reliable JSCC techniques for 3D video Flow

Analyze the MVC (Multiview Video Coding) tool of H.264/AVC

Analyze the SVC (Scalable Video Coding) tool of H.264/AVC

3D Technologies & Mobile Phone Streaming Real Time on Mobile Definition and/or ridefinition of Objective

Quality Parameters for Stereoscopic Flow

THANK YOU FOR YOUR ATTENTION!

vpullano@arces.unibo.it