Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen,...

31
Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center, Palo Alto

Transcript of Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen,...

Page 1: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Artifact-free High Dynamic Range Imaging

Orazio GalloUC, Santa Cruz

Natasha Gelfand, Wei-Chao Chen,Marius Tico, and Kari Pulli

Nokia Research Center, Palo Alto

Page 2: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 3: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 4: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 5: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Avoid any amount of ghosting.

Preserve semantic consistency of the final image.

Use as much information as possible from the stack.

Page 6: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Ghost Detection with Single Exposure Replacement.[Jacobs et al. '08, Reihnard et al. '05]Ghost Detection with Single Exposure Replacement.[Jacobs et al. '08, Reinhard et al. '05]

Collage-like Approaches.[Eden et al. '06, Cho et al. '04]Collage-like Approaches.[Eden et al. '06, Cho et al. '04]

Smarter Weighted Average.[Khan et al. '06]

Page 7: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Reference Frame Selection

Consistency Detection

HDR Generation

Poisson Blending

Page 8: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 9: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Irradiance (E) is the power incident on a surface [W∙m-2]

Exposure (X) is the radiant energy incident on a surface [J∙m-2]

X = E∙∆t

Page 10: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 11: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 12: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 13: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 14: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 15: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 16: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 17: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

5 exposures

4 exposures

3 exposures

2 exposures

1 exposure

Page 18: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

• a few more results

Page 19: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 20: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 21: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 22: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 23: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 24: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 25: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 26: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 27: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 28: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,
Page 29: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Future Work

• Generation of a consistent reference frame.

• Multiscale approach.

• Adaptive choice for the shape of the patches.

Page 30: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

thank you!

Page 31: Artifact-free High Dynamic Range Imaging Orazio Gallo UC, Santa Cruz Natasha Gelfand, Wei-Chao Chen, Marius Tico, and Kari Pulli Nokia Research Center,

Additional references

1.L. Bogoni. “Extending dynamic range of monochrome and color images through fusion.” International Conference on Pattern Recognition (ICPR), 3, 2000.

2.K. Jacobs, C. Loscos, and G.Ward. “Automatic high-dynamic range image generation for dynamic scenes.” IEEE Computer Graphics and Applications, 28(2):84–93, 2008.

3.S. B. Kang, M. Uyttendaele, S.Winder, and R. Szeliski. “High dynamic range video.” In SIGGRAPH ’03.

4.E. Khan, A. Akyuz, and E. Reinhard. “Ghost removal in high dynamic range images. 2006 IEEE International Conference on Image Processing,” pages 2005–2008, Oct. 2006.

5.E. Reinhard, G. Ward, S. Pattanaik, and P. Debevec. “High Dynamic Range Imaging: Acquisition, Display and Image-Based Lighting.” Morgan Kaufmann Publishers, December 2005.

6.P. Pérez, M. Gangnet, and A. Blake. “Poisson image editing”. ACM Trans. Graph. 22, 3, 2003.