Image Restoration with Union of Directional Orthonormal DWTs
-
Upload
shogo-muramatsu -
Category
Engineering
-
view
1.105 -
download
2
Transcript of Image Restoration with Union of Directional Orthonormal DWTs
![Page 1: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/1.jpg)
Image Restoration with
Union of Directional Orthonormal DWTs
S. Muramatsu1 N. Aizawa2 M. Yukawa1
1Dept. of Electrical and Electronic Eng., Niigata University, Japan
2Graduate School of Science & Technology, Niigata University, Japan
December 6, 2012
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 1 / 20
![Page 2: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/2.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 2 / 20
![Page 3: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/3.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
Deblurring
Super Resolution
Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 3 / 20
![Page 4: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/4.jpg)
Image Restoration with Sparse Representation
AWGNMeasurement Observed Unknownclean image process image
u∗
w
xP
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 4 / 20
![Page 5: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/5.jpg)
Image Restoration with Sparse Representation
AWGNMeasurement Observed Unknownclean image process image
Restored
image
Restorationu∗
w
x uP
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 4 / 20
![Page 6: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/6.jpg)
Image Restoration with Sparse Representation
AWGNMeasurement Observed Unknownclean image process image
Restored
image
Sparse representation
Redundant dictionary
Restorationu∗
y∗
w
x u
y
P
D D
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 4 / 20
![Page 7: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/7.jpg)
Image Restoration with Sparse Representation
AWGNMeasurement Observed Unknownclean image process image
Restored
image
Sparse representation
Redundant dictionary
Restorationu∗
y∗
w
x u
y
P
D D
Assumption
x = Pu∗ +w
u∗ = Dy∗
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 4 / 20
![Page 8: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/8.jpg)
Image Restoration with Sparse Representation
AWGNMeasurement Observed Unknownclean image process image
Restored
image
Sparse representation
Redundant dictionary
Restorationu∗
y∗
w
x u
y
P
D D
Assumption
x = Pu∗ +w
u∗ = Dy∗
Example of Problem Setting
(Qλ1 ) y = argmin
y‖x− PDy‖22 + λ‖y‖1
u = Dy
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 4 / 20
![Page 9: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/9.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 10: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/10.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 11: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/11.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 12: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/12.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
What kind of properties are preferable?
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 13: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/13.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
What kind of properties are preferable?
Redundant (sparse representation)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 14: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/14.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
What kind of properties are preferable?
Redundant (sparse representation)
Overlapping (smoothness)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 15: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/15.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
What kind of properties are preferable?
Redundant (sparse representation)
Overlapping (smoothness)
Symmetric (anti-phase-distortion)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 16: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/16.jpg)
Selection of Dictionary
Selection of an appropriate dictionary is a KEY STEP in (Qλ1 ).
Original Observed NS-Haar WT Proposal
What kind of properties are preferable?
Redundant (sparse representation)
Overlapping (smoothness)
Symmetric (anti-phase-distortion)
Tight (energy preservation)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 5 / 20
ISTA: Iterative Shrinkage/Thresholding Algorithm
![Page 17: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/17.jpg)
Selection of Dictionary
As well, the DIRECTIONAL property is of interest.
Good approximation for diagonal edges and textures.
Real-valued and compact-support dictionariesDictionaries Dir. Red. Ovl. Sym. Tight
DCT No No No Yes Yes
Haar DWT No No No Yes Yes
5-3/9-7 DWT No No Yes Yes No
NS-DCT No Yes Yes Yes Yes
NS-Haar DWT No Yes Yes Yes Yes
DirSOWT Yes No Yes Yes Yes
Contourlet Yes Yes Yes Restricted
Union of DirSOWTs Yes Yes Yes Yes Yes
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 6 / 20
Contourlet: [Do et al., IEEE TIP 2005 ]DirSOWT: [Muramatsu et al., IEEE TIP 2012 ]
![Page 18: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/18.jpg)
Purpose
A union of DirSOWTs was applied to image denoising as a redundantdictionary D and shown to be effective.
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 7 / 20
![Page 19: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/19.jpg)
Purpose
A union of DirSOWTs was applied to image denoising as a redundantdictionary D and shown to be effective.
S. Muramatsu et al.:“Directional lapped orthogonal transform: Theoryand design,” IEEE TIP, 2012.S. Muramatsu et al.:“Image denoising with union of directionalorthonormal DWTs,” IEEE Proc. ICASSP, 2012.S. Muramatsu et al.:“SURE-LET image denoising with multipledirectional LOTs,” Proc. PCS, 2012.
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 7 / 20
![Page 20: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/20.jpg)
Purpose
A union of DirSOWTs was applied to image denoising as a redundantdictionary D and shown to be effective.
S. Muramatsu et al.:“Directional lapped orthogonal transform: Theoryand design,” IEEE TIP, 2012.S. Muramatsu et al.:“Image denoising with union of directionalorthonormal DWTs,” IEEE Proc. ICASSP, 2012.S. Muramatsu et al.:“SURE-LET image denoising with multipledirectional LOTs,” Proc. PCS, 2012.
Extend the application of a union of DirSOWTs to image restoration.
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 7 / 20
![Page 21: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/21.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
Deblurring
Super Resolution
Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 8 / 20
![Page 22: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/22.jpg)
Review of 2-D Directional LOT
A DirSOWT, directional symmetric orthonormal WT, is a hierarchicaltree construction of a directional LOT (DirLOT).
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 9 / 20
S. Muramatsu et al.: “Directional lapped orthogonal transform:Theory and design,” IEEE TIP, May 2012.
![Page 23: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/23.jpg)
Review of 2-D Directional LOT
A DirSOWT, directional symmetric orthonormal WT, is a hierarchicaltree construction of a directional LOT (DirLOT).
A DirLOT is a non-separable extention of GenLOT to the 2-D case.
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 9 / 20
S. Muramatsu et al.: “Directional lapped orthogonal transform:Theory and design,” IEEE TIP, May 2012.
![Page 24: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/24.jpg)
Review of 2-D Directional LOT
A DirSOWT, directional symmetric orthonormal WT, is a hierarchicaltree construction of a directional LOT (DirLOT).
A DirLOT is a non-separable extention of GenLOT to the 2-D case.Critically-sampled, overlapping, orthonormal, symmetric, real-valuedand compact-support
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 9 / 20
S. Muramatsu et al.: “Directional lapped orthogonal transform:Theory and design,” IEEE TIP, May 2012.
![Page 25: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/25.jpg)
Review of 2-D Directional LOT
A DirSOWT, directional symmetric orthonormal WT, is a hierarchicaltree construction of a directional LOT (DirLOT).
A DirLOT is a non-separable extention of GenLOT to the 2-D case.Critically-sampled, overlapping, orthonormal, symmetric, real-valuedand compact-supportCapable to hold trend vanishing moments (TVMs)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 9 / 20
S. Muramatsu et al.: “Directional lapped orthogonal transform:Theory and design,” IEEE TIP, May 2012.
![Page 26: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/26.jpg)
Review of 2-D Directional LOT
A DirSOWT, directional symmetric orthonormal WT, is a hierarchicaltree construction of a directional LOT (DirLOT).
A DirLOT is a non-separable extention of GenLOT to the 2-D case.Critically-sampled, overlapping, orthonormal, symmetric, real-valuedand compact-supportCapable to hold trend vanishing moments (TVMs)
Constructed by a lattice structure
-
- -
- -
- -
- -
- -
-
ee
oo
oe
eo
2−(Ny+Nx)
z−1xz−1
xz−1
y
E0
U{x}
1 U{y}
NyU0
W0
↓M
↓M
↓M
↓M
d(z)
d(z) is a 2-D delay chain.E0 is a symmetric orthonormal matrix given by the 2-D DCT.
W0, U0 and U{d}nd are parameter orthonormal matrices.
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 9 / 20
S. Muramatsu et al.: “Directional lapped orthogonal transform:Theory and design,” IEEE TIP, May 2012.
![Page 27: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/27.jpg)
Construction of Redundant Dictionary
Examples of 2× 2-decomposition NS GenLOT/DirLOT bases
Iterative decompositionyields SOWT
→ →
D =[
ΦT
0∪π
2ΦT
φ1ΦT
φ2ΦT
φ3· · · ΦT
φK−1
]
Φ0∪π
2is a nondirectional SOWT with the classical two-order VMs.
Φφ is a DirSOWT with the two-order TVMs for the directionuφ = (sinφ, cosφ)T .
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 10 / 20
![Page 28: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/28.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
Deblurring
Super Resolution
Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 11 / 20
![Page 29: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/29.jpg)
ISTA with a Tight Frame
ISTA solves (Qλ1 ) exactly.
� �
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 12 / 20
![Page 30: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/30.jpg)
ISTA with a Tight Frame
ISTA solves (Qλ1 ) exactly.
� �
If D is a tight frame and DDT = K I
⇒ L = Kλmax(DTPTPD) = Kλmax(P
TP)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 12 / 20
![Page 31: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/31.jpg)
ISTA with a Tight Frame
ISTA solves (Qλ1 ) exactly.
� �
If D is a tight frame and DDT = K I
⇒ L = Kλmax(DTPTPD) = Kλmax(P
TP)
Linear measurement process P is pluggable and applicable to
DeblurringSuper resolutionInpainting and so on
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 12 / 20
![Page 32: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/32.jpg)
Examples of Measurement Processes
Relation between measurement process and its adjoint
Deblurring
wP PT
h[ny, nx] h[−ny,−nx]
Super resolution
Downsampler Upsampler
P PT
f [ny, nx] f [−ny,−nx]
Inpainting
Pixel loss Zero padding Pixel loss Zero padding
P PT = P
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 13 / 20
![Page 33: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/33.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
Deblurring
Super Resolution
Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 14 / 20
![Page 34: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/34.jpg)
Original Pictures and Adopted Transforms
goldhill lena barbara baboon
Original pictures u∗ of size 512× 512, 8-bit grayscale.
Adopted dictionariesAbrv. Features
NSHTTwo-level non-subsampled Haar DWT,
separable, tight, nondirectional
UDN4Union of six-level SOWT and DirSOWTs with two TVMs of[Ny,Nx]
T = [4, 4]T , non separable, tight, multidirectional
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 15 / 20
![Page 35: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/35.jpg)
Simulation Results in SSIM - Deblurring
Observed Wiener NSHT(K = 7) UDN4(K = 5)
Partial results of deblurring for “lena.”
Picture Wiener NSHT(λ) UDN4(λ)
goldhill 0.633 0.720 (0.0007) 0.724 (0.0026)
lena 0.666 0.796 (0.0006) 0.820 (0.0054)
barbara 0.543 0.654 (0.0007) 0.667 (0.0043)
baboon 0.517 0.529 (0.0005) 0.528 (0.0000)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 16 / 20
![Page 36: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/36.jpg)
Simulation Results in SSIM - Super Resolution
Observed Bicubic NSHT(K = 7) UDN4(K = 5)
Partial results of super resolution for “lena.”
Picture Bicubic NSHT(λ) UDN4(λ)
goldhill 0.6821 0.767 (0.0003) 0.759 (0.0004)
lena 0.802 0.859 (0.0003) 0.854 (0.0004)
barbara 0.646 0.701 (0.0004) 0.696 (0.0004)
baboon 0.433 0.551 (0.0002) 0.544 (0.0003)
1Wrongly typed in the proceedingsS. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 17 / 20
![Page 37: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/37.jpg)
Simulation Results in SSIM - Inpainting
Observed Median NSHT(K = 7) UDN4(K = 5)
Partial results of inpainting for “lena.”
Picture Median NSHT(λ) UDN4(λ)
goldhill 0.632 0.609 (0.0318) 0.931 (0.0197)
lena 0.655 0.560 (0.0385) 0.945 (0.0206)
barbara 0.602 0.647 (0.0300) 0.944 (0.0220)
baboon 0.522 0.638 (0.0324) 0.907 (0.0251)
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 18 / 20
![Page 38: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/38.jpg)
Outline
1 IntroductionImage Restoration with Sparse RepresentationSelection of DictionaryPurpose
2 Union of Directional SOWTsReview of 2-D Directional LOTConstruction of Redundant Dictionary
3 Image Restoration with ISTAISTA with a Tight FrameExamples of Measurement Processes
4 Simulation ResultsOriginal Pictures and Adopted TransformsDeblurring, Super Resolution and Inpainting
Deblurring
Super Resolution
Inpainting
5 Conclusions
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 19 / 20
![Page 39: Image Restoration with Union of Directional Orthonormal DWTs](https://reader033.fdocuments.in/reader033/viewer/2022042706/5883fa5a1a28ab884b8b496d/html5/thumbnails/39.jpg)
Conclusions
A novel image restoration technique was proposed by introducing aunion of DirSOWTs.
The significance is verified through the application to
DeblurringSuper resolution andInpainting
The proposed dictionary is shown to be superior to or comparablewith the non-subsampled Haar WT.
Thank you very much for your attention!
S. Muramatsu et al. (Niigata Univ.) Image Restoration with DirSOWTs December 6, 2012 20 / 20
This work was supported by JSPS KAKENHI (23560443). We would like to express ourappreciation to Dr. Masao Yamagishi and Mr. Shunsuke Ono, Tokyo Institute ofTechnology, for their valuable comments.