Multimedia RepresentationsAdrian Munteanu
2
Multimedia
Research Activities
Multimedia Representations
Compression Technologies(Images, Video, 3D Graphics, 3D textures)
Development of new algorithms, customized solutions
In-depth know-how of various standards: JPEG-2000, H.26x, MPEG-4, VCEG, etc.
Focus on various application domains for a broad range of imaging modalities
What are meshes? Representations of 3D virtual objects Set of points Set of triangles, quads, …
MESHES
called polygons
Scalable Compression of Meshes
3
Resolution scalability
Example:
Resolution level 1(original)
Resolution level 2
Resolution level 3 Resolution level 4
Scalable Compression of Meshes
4
Why scalability? Progressive reconstruction Level-Of-Detail (LOD)
LOD calls for resolution scalability!
Scalable Compression of Meshes
5
Rabbit Igea
+30% compression
Provides state-of-the-art compression performance Resolution scalable!
3xC Codec (Context-conditioned Composite Coding of meshes)
Scalable Compression of Meshes
6
+30% compression
7
Compressed 140 KB (206:1)
Original Semi-regular “Bob” Mesh (© Alcatel-Lucent)
28.13 MB
Real world compression performance Scalable Compression of Meshes
Right
StereoEncoding
Left
3D video: from stereo to multi-view
8
3D video: from stereo to multi-view
Right
MultiviewEncodingCenter
Left Autostereoscopic display
9
Free Viewpoint Television
3D Video: Compression
Encode a pair of depth and texture information of extreme left and extreme right cameras;
Synthesize all middle views
11
iMinds-FMI: hybrid 3D coding system → based on H.264/AVC and HEVC
3D video: from stereo to multi-view
multi-view coding of
texture and depthcompatible
with installed
base layersupport for stereo and autostereogains of
35% compared to current MVC technology
0%
20%
40%
60%
80%
100%3D overhead
12
13
Segmentation-based 3D Depth coding
Encoding time: ~5 times smaller Subjective tests:
Alternative for high-complexity codecs
14
Challenges for the future The imaging modalities are getting highly diversified
HolographyHolographyHolography3D Video3D Video
Multiview videoMultiview videoMultiview video
Depth mapsDepth mapsDepth maps
High-quality 3D graphicsHigh-quality 3D graphicsHigh-quality 3D graphicsCapsule endoscopyCapsule endoscopyCapsule endoscopy
Top Related