Post on 23-Mar-2020
ITU-T VICA Workshop22-23 July 2005 - ITU Headquarter - Geneva
International Telecommunication Union
JPEG 2000 ExtensionsJPEG 2000 ExtensionsFrédéric Dufaux
Ecole Polytechnique Fédérale de Lausanne (EPFL)Institut de Traitement des Signaux
2ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
ISO/IEC 15444 – JPEG 2000
o Part 1 - Core coding systemo Part 2 - Extensionso Part 3 - Motion JPEG 2000 o Part 4 - Conformance o Part 5 - Reference softwareo Part 6 - Compound image file format o Part 8 - JPSEC: Secure JPEG 2000o Part 9 - JPIP: Interactivity tools, APIs and protocols o Part 10 - JP3D: Extensions for 3D datao Part 11 - JPWL: Wireless o Part 12 - ISO Base Media File Formato Part 13 – An entry level JPEG 2000 encoder
3ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Work Plan
05/1105/0705/0304/0703/0702/07JPWL
06/0706/0305/1105/0702/1002/03JP3D
04/1004/0403/0703/0302/0702/03JPIP
05/1105/0704/1104/0402/1002/03JPSEC
ISFDISFCDCDWDCFP
4ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC: Secure JPEG 2000
Services addressed:o Confidentiality
• Encryption or ciphering to conceals original contento Integrity verification
• Image data integrity: bit exact verification• Image content integrity: perceptual meaning verification
o Source authentication• Identity of the party which generated the content
o Conditional access• Restrict access to image data or parts of it
o Secure scalable streaming and transcoding• Streaming and transcoding without unprotecting the content
o …
5ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC Framework
Open and flexible framework
JPSEC codestream
Proprietary Tool ID
JPSEC Syntax Parser
JPSEC Unprotection
Tools
JPSEC Syntax Writer
JPSEC Protection
Tools
JPSEC protector JPSEC unprotector
Security Services: • Confidentiality • Integrity Verification • Source Authentication• �
JPSEC Registration
Authority
Tool Description
JPSEC Tools: • Encryption (AES, DES, �) • Digital Signature (RSA, �) • Message Auth. Code • Watermarking • Proprietary Tools • �
6ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC Framework
Creation and consumption of JPSEC content
JPEG-2000codestream
JPSEC codestream
JPEG-2000codestream
JPEG-2000 Decoder
JPSEC Unprotector
JPSEC Protector
JPEG-2000 Encoder
JPSEC codestream Image Image
Image
JPSECEncoder & Protector
JPSECUnprotector & Decoder
Case 1
Case 2
Case 3 JPEG-2000or JPSEC
codestream
JPSEC Protector 1
JPSEC’ JPSEC
Protector 2
JPSEC” JPSEC
Protector 3
JPSEC* JPSEC
Unprotector 3
JPSEC”
JPSEC Unprotector 2
JPSEC’
JPSEC Unprotector 1
JPEG-2000or JPSEC
codestream
Image
7ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPSEC ROI-Scrambling
o Add pseudo-random noiseo Performed in the wavelet
domaino Based on ROI mechanisms in
JPEG 2000o Efficient for arbitrary-shape
regionso Adjust distortion from
fuzziness to noiseo Application
• Video surveillance preserving privacy
8ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPIP: Interactivity tools, APIs and Protocols
o Tools for supporting image and metadata delivery in a networked environment
o Exploit JPEG 2000 properties• Random access • Codestream reordering• Incremental decoding
9ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPIP: Interactivity tools, APIs and Protocols
Protocol overview
Protocol stack
Cache
Client
Cache Model*
Server
HTTP, TCP, UDP
*Only if State is present
Image Metatdata Server Capabilities JPP- or JPT-streams
Display Metatdata Client Capabilites Data Limits Multiple Server Responses
Multiple Client Requests
JPIP
IP
TCP UDP
HTTP
10ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JP3D: Extensions for 3D Data
o Extension of JPEG 2000 parts 1 and 2o Compress samples along all three dimensionso Targets applications:
• Medical Imaging (MRI, CAT, PET scans)• Scientific Modeling and Simulation• Remote Sensing (hyperspectral imagery,
geophysical/astrophysical measurements)• …
11ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JP3D: Extensions for 3D Data
o Extends standard JPEG 2000 technology from two to three dimensions
• Wavelet transform• Quantization• Coefficient bit modeling
o New technologies• 3D context probability models for entropy
coding• Variable resolution sampling grids• Coding of floating point data
12ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL: Wireless
o Multimedia wireless applications are becoming ubiquitous• Sales of camera-equipped cell phones exceed those of
standalone digital cameras• Importance of efficient and robust wireless imaging solutions
o JPEG 2000 is well-suited for wireless applications• High coding efficiency → good visual quality• Seamless scalability → quality of service and pricing strategies
o JPEG 2000 Wireless (JPWL)• Efficient transmission over error-prone networks• Normative and information tools for error protection and
correction• Forward Error Correcting (FEC) codes• Header protection• Unequal Error Protection (UEP)• Data partitioning and interleaving• Robust arithmetic coding
13ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL: Wireless
o Headers are most important part of code stream• FEC for strong protection of Main and Tile-part headers• Add redundancy bits while keeping backward
compatibilityo Progressive quality transmission
• Layered code stream: each layer contributes to improve quality
• UEP: decreasing protection as layer importance decreases
Mai
n H
eade
r
Tile
-par
t H
eade
r
Pack
et
Pack
et
Pack
etLayer 1
high importance
……
Pack
et
Pack
et
Pack
et
Layer 2medium importance
…
Pack
et
Pack
et
Pack
et
Layer nlow importance
…
Headerscritical importance
14ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
JPWL Unequal Error Protection
384 kb/s, CIF, 15 f/s, 3 quality layersBER=10-3 (WCDMA error patterns)
JPEG 2000
JPWL
26.0324.18average
29.8027.35Soccer
18.6317.71Mobile
22.6021.19Harbor
28.0725.73Foreman
30.4328.09Crew
26.6524.98City
PSNRJPWL
PSNRJPEG 2000sequence
15ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Motion JPEG 2000 vs MPEG-4
InaccurateAccurateRate control
HighLowCoding Delay
HighLowEncodercomplexity
MC DCTIntra-frameWaveletCoding
BlockRinging
Blur RingingArtifacts
MPEG-4Motion JPEG 2000
InefficientEfficientScalability
LowHighError resilience
16ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
Motion JPEG 2000 vs MPEG-4
128 kb/s, QCIF, 6 f/sBER=10-4 (WCDMA error patterns)
30.01
27.75
36.82
30.21
31.29
25.34
33.36
24.67
34.25
26.44
PSNRMPEG-4IPP..IPP
PSNRMotion
JPEG2000
30.32average
26.69Tempest
38.25Suzie
32.48Football
29.62Waterfall
26.90Letters
33.63Animals
22.87Mobile
35.06New York
27.41Balloons
JPEG 2000
MPEG-4
17ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva dates
ITU-T
The End !
o Questions?