COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression...
Transcript of COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression...
![Page 1: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/1.jpg)
COL783: Digital Image ProcessingPremKalra
[email protected]://www.cse.iitd.ac.in/~pkalra/col783
DepartmentofComputerScienceandEngineering
IndianInsEtuteofTechnologyDelhi
![Page 2: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/2.jpg)
RecapSome definitions
• Compression ratio • Fidelity criteria
Data Redundancy • Coding • Interpixel • Psychovisual
Compression techniques • Loss-less and Lossy • Symmetric and Asymmetric
Variable length coding • Huffman Coding • Information theoretic analysis
Entropy
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 3: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/3.jpg)
ImageCompressionKraft’s inequality
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 4: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/4.jpg)
ImageCompressionLower Bound
Shannon’sCodingTheorem
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 5: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/5.jpg)
ImageCompressionLower Bound
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 6: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/6.jpg)
ImageCompression
Variants of Huffman Coding • Higher order estimate of entropy • Truncated Huffman Coding • Dynamic or Adaptive Huffman Coding
Efficiency of Huffman Coding
H(z)/L(z)
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 7: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/7.jpg)
ImageCompressionArithmetic Coding BasicIdea:a) LikeHuffmancodingrequirespriorknowledgeofprobabiliEesb) UnlikeHuffmancoding,whichassignsvariablelengthcodestosymbolsarithmeEc
codingassignscodestoavariablegroupofsymbolsi.e.themessage.c) Thereisnoone-to-onecorrespondencebetweenthesymbolandits
correspondingcodeword.d) Thecodeworditselfdefinesarealnumberwithinthehalf-openinterval[0,1)and
asmoresymbolsareadded,theintervalisdividedintosmallerandsmallersubintervals,basedontheprobabiliEesoftheaddedsymbols.
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 8: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/8.jpg)
ImageCompressionArithmetic Coding
Endofmessageorlengthofmessageisknown.Source:DigitalImageProcessing,GonzalezandWoods.Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 9: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/9.jpg)
ImageCompressionArithmetic Coding
Finalcode068
Source:DigitalImageProcessing,GonzalezandWoods.Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 10: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/10.jpg)
ImageCompressionArithmetic Decoding Followsencodingprocedure
Code068maybeconvertedtotherealnumber0.068,whichfallsinthefirstsub-interval[0,0.2)thereforefirstsymbolisa1,andsoon.
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 11: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/11.jpg)
ImageCompressionDictionary based methods
• CompressingmulEplestringscanbemoreefficientthancompressingsinglesymbolsonly(e.g.Huffmanencoding).
• StringsofsymbolsareaddedtoadicEonary.Lateroccurrencesarereferenced.
• StaEcdicEonary:EntriesarepredefinedandconstantaccordingtotheapplicaEonofthetext
• AdapEvedicEonary:Entriesaretakenfromthetextitselfandcreatedon-the-fly
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 12: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/12.jpg)
ImageCompressionDictionary based methods: LZ77 ByLempelandZivin1977aboutlosslesscompressionwithanadapEvedicEonary.• Runsthroughthetextinaslidingwindow• Twobuffersareused-search(history)bufferandalookaheadbuffer.• ThesearchbufferisusedasdicEonary• Sizesofthesebuffersareparametersofthedesign
Source:h4p://jens.jm-s.de/comp/LZ77-JensMueller.pdfDigital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 13: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/13.jpg)
ImageCompressionDictionary based methods: LZ77
Look-ahead
Search
Source:h4p://jens.jm-s.de/comp/LZ77-JensMueller.pdf
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 14: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/14.jpg)
ImageCompressionDictionary based methods: LZ77
Decoding
Source:h4p://jens.jm-s.de/comp/LZ77-JensMueller.pdf
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 15: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/15.jpg)
ImageCompressionDictionary based methods: LZW ExtendedbyWelch(Lempel,ZivandWelch)
Thiscodingschemehasbeenadoptedinavarietyofimagingfileformats,suchasthegraphicinterchangeformat(GIF),taggedimagefileformat(TIFF)andtheportabledocumentformat(PDF).
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 16: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/16.jpg)
ImageCompressionDictionary based methods: LZW ExtendedbyWelch(Lempel,ZivandWelch)• UnlikeHuffmancodingandarithmeEccoding,thiscodingschemedoes
notrequireaprioriknowledgeoftheprobabiliEesofthesourcesymbols.
• Thecodingisbasedona“dicEonary”or“codebook”containingthesourcesymbolstobeencoded.ThecodingstartswithaniniEaldicEonary,whichisenlargedwiththearrivalofnewsymbolsequences.
• ThereisnoneedtotransmitthedicEonaryfromtheencodertothedecoder.ThedecoderbuildsanidenEcaldicEonaryduringthedecodingprocess
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 17: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/17.jpg)
ImageCompressionDictionary based methods: LZW ExtendedbyWelch(Lempel,ZivandWelch)Example: 32 32 34 32 34 32 32 33 32 32 32 34
ConsideradicEonaryofsize256locaEons(numbered0to255)thatcontainsentriescorrespondingtoeachpixelintensityvalueintherange0-255.
Source:h4ps://nptel.ac.in/courses/117/105/117105083/#Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 18: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/18.jpg)
ImageCompressionDictionary based methods: LZW ExtendedbyWelch(Lempel,ZivandWelch)
Source:h4ps://nptel.ac.in/courses/117/105/117105083/#Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 19: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/19.jpg)
ImageCompressionRun Length Coding Run: a string of the same symbol Example
input: AAABBCCCCCCCCCAA output: A3B2C9A2
compression ratio = 16/8 = 2
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 20: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/20.jpg)
ImageCompressionPredictive Coding Basic premise: Current pixel is similar to the previous pixel (coherence)
Differential Coding
d(x,y) = I(x,y) – I(x-1,y)
d(x,y) prediction error which is to be encoded.
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 21: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/21.jpg)
ImageCompression
Compression
Predictive Coding
Source:DigitalImageProcessing,GonzalezandWoods.Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 22: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/22.jpg)
ImageCompressionPredictive Coding Decompression
Source:DigitalImageProcessing,GonzalezandWoods.Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783
![Page 23: COL783: Digital Image Processingpkalra/col783/session-17.pdf · 2021. 4. 22. · Image Compression Dictionary based methods: LZ77 By Lempel and Ziv in 1977 about lossless compression](https://reader035.fdocuments.in/reader035/viewer/2022070222/613d4191984e1626b6577901/html5/thumbnails/23.jpg)
ImageCompressionPredictive Coding
Digital Image Processing http://www.cse.iitd.ac.in/~pkalra/col783