Overview of JPEG 2000 extensions for security and wireless ... · Multimedia Signal Processing...

Multimedia Signal Processing Group Swiss Federal Institute of Technology

1

Overview of JPEG 2000 extensions for security and

wireless applications Touradj Ebrahimi Frédéric Dufaux

Multimedia Signal Processing Group Ecole Polytechnique Fédérale de Lausanne – EPFL

Mobile Multimedia/Image Processing, Security, and Applications 2008 Orlando, FL, March 19th, 2008


2

• JPEG 2000 Baseline (Part I) has been adopted as an international standard since December 2000

• First image compression standard making use of wavelet transform

• In addition to compression efficiency, it offers several new features useful in today and future multimedia applications o Region of Interest Coding o Lossy to lossless embedded coding o Superior error resiliency o Scalable o …

JPEG 2000 image compression standard


3


4


5 JPEG 2000 coding overview

• Encoding algorithm:

MSB

Bit stream

LSB MSB

LSB

sign

Original image

Wavelet Transform

Quantization Entropy Coding

Bit stream code-block 1 MSB LSB

MSB LSB

MSB LSB

MSB LSB

MSB LSB

Bit stream code-block 2

Bit stream code-block 3

Bit stream code-block N-1

Bit stream code-block N

Rate Allocation

header

codestream

code-block

Packet 1 Packet 2 Packet P


6 JPEG 2000 progressive coding

Progressive by resolution Progressive by quality

Res 0

Res 1

Res 2

MSB LSB

MSB LSB

MSB LSB

MSB LSB

MSB LSB

header

codestream

header

codestream

Layer 1 Layer 2 Layer 3


7

Jpeg 20:1

Original Image

Jpeg 50:1

Jp2 20:1 Jp2 50:1 Jp2 100:1

Progressive JPEG 2000 versus progressive JPEG


8 Error resilience visual results

Bit error rate = 10-5

JPEG 16:1 CR JPEG 2000 16:1 CR

Images with median quality, of 200 runs


9 Error resilience visual results

Bit error rate = 10-4

Images with median quality, of 200 runs

JPEG 16:1 CR JPEG 2000 16:1 CR


10 JPEG 2000 in hundreds of products

Non-native software


11 JPEG 2000 deployment

• A few successful application domains for JPEG 2000: Digital cinema (DCI) Medical imaging (DICOM) Satellite imaging Video surveillance Archival


12

• Part II: Extension tools to cover specific applications (JPX)

• Part III: Motion JPEG 2000 (MJP)

• Part IV: Conformance

• Part V: Reference software

• Part VI: Compound images file format (JPM)

• Part VII: EMPTY

• Part VIII: Secure JPEG 2000 (JPSEC)

• Part IX: Interactivity and Protocols (JPIP)

• Part X: Volumetric (JP3D)

• Part XI: Wireless (JPWL)

• Part XII: ISO media file format

• Part XIII: Reference encoder specification

• Part XIV: XML syntax description

JPEG 2000 extensions


13

JPSEC


14

• With digital content, it is easy to o Manipulate o Copy o Distribute at negligible cost

• Security is often a major issue in applications o Content protection o Authentication o Data integrity

• JPEG 2000 offers new compelling features o JPEG 2000 has to also support secure imaging

Motivations behind JPSEC


15

• Confidentiality o Encryption or ciphering to conceal original content

• Integrity verification o Image data integrity: bit exact verification o Image content integrity: robust verification

• Source authentication o Identity of the party which generated the content

• Conditional access o Restrict access to image data or parts of it

• Secure scalable streaming and transcoding o Streaming and transcoding without unprotecting the content

Main security services offered by JPSEC


16

Two categories • Well-known cryptographic/security methods

o AES, DES, 3DES, RC4, RSA, MD5, SHA-1,… o Pre-defined templates to specify parameters o Template protection tools

• Proprietary methods o Should be registered with the JPSEC Registration Authority (RA) o Assigned a unique identification number o Provision is made for future tools o Registration authority protection tools

JPSEC tools


17

• Open and flexible framework

JPSEC framework


18

• Creation and consumption of JPSEC content

JPSEC framework


19

• Normative: o JPSEC syntax specifying the information required for interpreting a

secure image Security services, JPSEC tools Which parts of the image data are protected

o Registration of security tools with the JPSEC RA

• Informative o Examples of security tools and typical use cases

Normative and informative parts in JPSEC


20

• Main header (mandatory) • Overall information about the protection tools

Syntax: SEC marker segment


21

• Template protection tools

• Registration authority protection tools

• Zone of influence, template, processing domain, granularity

Syntax: SEC marker segment


22

• In the bitstream (optional) • Transmit additional or alternative parameters

Syntax: INSEC marker segment


23

• Conditional access by resolution, quality, region of interest, …

Example: Conditional access


24 Example: Conditional access

Opportunities

• The camera captures the video • People are detected and automatically scrambled • No access to video in clear • Scrambled data is stored • A secret encryption key protects scrambled objects

and is kept by law-enforcement authorities, or any trusted third party

• The security level of the encryption technology is similar to banking institutions

Scrambling Process

Product : « Privacy One »

• Encryption key(s) kept by competent authority

• If unlawful act detected

• Authority decision to unscramble

• Use of secret encryption key(s)

• Unscrambling of area corresponding to incriminated person(s)

Unscrambling Process

Product : « Privacy Key »


25

JPWL


26

• Wireless imaging is becoming ubiquitous o Sales of camera-equipped cell phones exceed those of stand-alone

digital cameras

• JPEG 2000 is well-suited for wireless applications o International Standard (IS) since 2000 o High coding efficiency

• Error resilience tools in baseline JPEG 2000 are limited to: o Detecting the occurrence of errors o Concealing the erroneous data o Resynchronizing the decoder

Motivations behind JPWL


27

• Protect the codestream against transmission errors o Add redundancy (e.g. FEC, EEP, UEP) o Partition and interleave the data o Proprietary tools registered with the JPWL Registration Authority

• Describe the sensitivity of the codestream to transmission errors o Unequal error protection o Selective retransmission

• Describe the locations of residual errors o Request retransmission o Prevent decoding of corrupted parts of the codestream

Main protection solutions offered by JPWL


28 JPWL framework


29

• Signal which protection tools (normative and informative) are used

o Informative tools registered with the JPWL Registration Authority

Syntax: Error Protection Capability (EPC)


30

• Information about the error protection parameters and redundancy data o Protect Main and Tile-part headers o Protect the remaining of the bitstream o Backward compatible

o Reed-Solomon codes

Syntax: Error Protection Block (EPB)


31

• Sensitivity of different parts of the codestream to transmission errors o Unequal Error Protection o Selective retransmission

o Byte-range, packet-range, packets o Priority classes, MSE, PSNR

Syntax: Error Sensitivity Descriptor (ESD)


32

• Presence and location of residual errors o Request retransmission o Better handling of the corrupted codestream by a decoder

o Byte-range, packet-range, packets

Syntax: Residual Error Descriptor (RED)


33

• EPB to protect • Main header • Tile-part header • Data packets

• Image encoded with 3 layers • 0.125 bpp, 0.25 bpp, 0.5 bpp

• Binary Symmetric Channel • Reed Solomon (RS) • Overall protection of R=2/3

Example: Unequal Error Protection


34 Example: EPB for unequal error protection


35

Binary Symmetric Channel Reed Solomon (RS) Overall protection of R=2/3

EEP: • RS(30,20) for 3 layers

UEP: • RS(50,20) for layer 1 • RS(30,20) for layer 2 • no protection for layer 3

Example: EEP versus UEP PSNR results


36

Equal Error Protection PSNR=18.83 dB

Unequal Error Protection PSNR=26.95 dB

BER=10-2

Example: EEP versus UEP visual results


37 Conclusions

• JPEG 2000 Baseline has been successfully deployed in several important applications

• JPSEC and JPWL while bringing the same strengths as those in JPEG 2000 Baseline, further enhance security and protection of compressed images

• JPSEC and JPWL both provide a flexible and open syntax allowing for normative and proprietary solutions under the same framework

• JPSEC and JPWL both manage proprietary solutions through registration authority mechanisms


38 Acknowledgements

• This work has been carried out under the EC funded European Network of Excellence VISNET-II

• Some of the materials presented here have been contributed from the following individuals: Giuseppe Baruffa, Fabrizio Frescura, and Didier Nicholson

Overview of JPEG 2000 extensions for security and wireless ... · Multimedia Signal Processing...

Documents

Transcript of Overview of JPEG 2000 extensions for security and wireless ... · Multimedia Signal Processing...