Super resolution from a single image
-
Upload
lakkhana-mallikarachchi -
Category
Technology
-
view
2.957 -
download
4
Transcript of Super resolution from a single image
![Page 1: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/1.jpg)
Super-Resolution from a Single Image
by Daniel Glasner, Shai Bagon and Michal Irani
Presented by : Lakkhana MallikarachchiSupervised by : Prof. N.D. Kodikara
![Page 2: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/2.jpg)
Authors
Daniel Glasner
› B.Sc and M.Sc at Tel Aviv University, Israel.› Reading for a PhD at The Weizmann Institute of
Science, Israel.› Web - http://www.wisdom.weizmann.ac.il/~glasner/
Shai Bagon
› PhD at The Weizmann Institute of Science, Israel.› Web - http://www.wisdom.weizmann.ac.il/~bagon/
![Page 3: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/3.jpg)
Authors
Michal Irani› Professor in Computer Science at The
Weizmann Institute of Science, Israel.› Research Interests - Computer Vision and Video
Information Analysis› Web - http://www.wisdom.weizmann.ac.il/~irani/
![Page 4: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/4.jpg)
The need of Super Resolution Main approaches of SR Proposed method Experimental results of the proposed
method
Outline
![Page 5: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/5.jpg)
Why Super Resolution?
Low Resolution
High Resolution
Resize
![Page 6: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/6.jpg)
Generating high resolution imagewith more resolving powerusing one or more low resolution
images.
› more resolving power – more details
What Is Super Resolution?
![Page 7: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/7.jpg)
Multi image super resolution
Example based super resolution
Super Resolution Methods
![Page 8: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/8.jpg)
Several images of the same scenery.
Each image will have different information of the same scenery.
Multi Image Super Resolution
![Page 9: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/9.jpg)
Image database with HR/LR image pairs
Replace similar LR patches with corresponding HR patches.
Example Based Super Resolution
+
LR HR
![Page 10: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/10.jpg)
Combine multi image SR with example based SR
Without use external source
Proposed Approach
![Page 11: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/11.jpg)
5x5 pixel image patches
More than 60% of image patches have 9 or more recurrences within same scale or in different scales
Patch Redundancy
![Page 12: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/12.jpg)
Use patch redundancy in same scale to model multi image super resolution problem
Use patch redundancy in different scales to model example based super resolution problem
Proposed Method
![Page 13: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/13.jpg)
Problem Model
L1 L2 L3
H
![Page 14: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/14.jpg)
Problem Model
p
q
![Page 15: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/15.jpg)
Find similar patches within scale Nearest Neighbor
Multi Image to Single Image
![Page 16: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/16.jpg)
How to find cross-scale patch redundancy?
![Page 17: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/17.jpg)
Finding Similar Patches
I0 = L
I-1
I1 = H
![Page 18: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/18.jpg)
Finding Similar Patches
I0 = L
I-1
I1
I2 = H
![Page 19: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/19.jpg)
Finding Similar Patches
FindNN
FindNN
𝑝
~𝑝
I0 = L
I-1
I-2
I1
I2 = H
![Page 20: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/20.jpg)
Finding Similar Patches
FindNN P
are
nt
FindNN Parent
𝑝
~𝑝
I0 = L
I-1
I-2
I1
I2 = H
𝑠𝑙 .~𝑝
![Page 21: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/21.jpg)
Finding Similar Patches
FindNN P
are
nt
Copy
FindNN Parent Copy
𝑝
~𝑝
𝑠𝑙 .~𝑝
𝑠𝑙 .𝑝
I0 = L
I-1
I-2
I1
I2 = H
![Page 22: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/22.jpg)
RGB YIQ Extract Y component (Luminance) Apply SR to Y component Use interpolation methods to I and Q
components (Chrominance) Combine YIQ
Color Images
![Page 23: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/23.jpg)
Experimental Results
Bi-cubic interpolation Proposed Method
LR
![Page 24: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/24.jpg)
Experimental Results
Nearest NeighborProposed Method
LR
![Page 25: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/25.jpg)
Experimental Results
Example BasedProposed Method
LR
![Page 26: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/26.jpg)
Experimental Results
Bi-cubic interpolation Proposed Method
LR
![Page 27: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/27.jpg)
Two main approaches of Super Resolution
Observation about patch redundancy Unified approach of Super Resolution Experimental results
Summery
![Page 28: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/28.jpg)
D. Glasner, S. Bagon and M. Irani, "Super-resolution from a single image," in IEEE 12th International Conference on Computer Vision (ICCV 2009), Kyoto, Japan, Sep. 29 - Oct. 2, 2009, pp. 349-356.
http://www.wisdom.weizmann.ac.il/~vision/SingleImageSR.html
http://cs.brown.edu/courses/csci1950-g/results/final/pachecoj
References
![Page 29: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/29.jpg)
Any Question?
![Page 30: Super resolution from a single image](https://reader036.fdocuments.in/reader036/viewer/2022062513/555caad0d8b42aad358b4ce2/html5/thumbnails/30.jpg)
Thank you…