Multimedia RepresentationsAdrian Munteanu

2

Multimedia

Research Activities

Multimedia Representations

Compression Technologies(Images, Video, 3D Graphics, 3D textures)

Development of new algorithms, customized solutions

In-depth know-how of various standards: JPEG-2000, H.26x, MPEG-4, VCEG, etc.

Focus on various application domains for a broad range of imaging modalities

What are meshes? Representations of 3D virtual objects Set of points Set of triangles, quads, …

MESHES

called polygons

Scalable Compression of Meshes

3

Resolution scalability

Example:

Resolution level 1(original)

Resolution level 2

Resolution level 3 Resolution level 4

Scalable Compression of Meshes

4

Why scalability? Progressive reconstruction Level-Of-Detail (LOD)

LOD calls for resolution scalability!

Scalable Compression of Meshes

5

Rabbit Igea

+30% compression

Provides state-of-the-art compression performance Resolution scalable!

3xC Codec (Context-conditioned Composite Coding of meshes)

Scalable Compression of Meshes

6

+30% compression

7

Compressed 140 KB (206:1)

Original Semi-regular “Bob” Mesh (© Alcatel-Lucent)

28.13 MB

Real world compression performance Scalable Compression of Meshes

Right

StereoEncoding

Left

3D video: from stereo to multi-view

8

3D video: from stereo to multi-view

Right

MultiviewEncodingCenter

Left Autostereoscopic display

9

Free Viewpoint Television

3D Video: Compression

Encode a pair of depth and texture information of extreme left and extreme right cameras;

Synthesize all middle views

11

iMinds-FMI: hybrid 3D coding system → based on H.264/AVC and HEVC

3D video: from stereo to multi-view

multi-view coding of

texture and depthcompatible

with installed

base layersupport for stereo and autostereogains of

35% compared to current MVC technology

0%

20%

40%

60%

80%

100%3D overhead

12

13

Segmentation-based 3D Depth coding

Encoding time: ~5 times smaller Subjective tests:

Alternative for high-complexity codecs

14

Challenges for the future The imaging modalities are getting highly diversified

HolographyHolographyHolography3D Video3D Video

Multiview videoMultiview videoMultiview video

Depth mapsDepth mapsDepth maps

High-quality 3D graphicsHigh-quality 3D graphicsHigh-quality 3D graphicsCapsule endoscopyCapsule endoscopyCapsule endoscopy