Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging...

14
Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb

Transcript of Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging...

Page 1: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb

Page 2: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Conservation Documentation

Scientific Imaging

CollectionsPhotography

Measurement and Material Identification

Exhibition and Catalogue

Record Condition, Inform Care, and Increase Understanding

Smithsonian National Museum of the American Indian Inka Qero (NMAI 16/3605)

Museum Imaging

Page 3: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

UV-Induced Visible Luminescence Visible Reflected IR

Smithsonian American Art MuseumUntitled (SAAM 1986.65.339)

Spectral and 3D Imaging

Page 4: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Accessible Devices and Workflows

Smithsonian American Art MuseumUntitled (SAAM 1986.65.339)

Page 5: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Visible

Reflected IR

Smithsonian American Art MuseumUntitled (SAAM 1986.65.339)

Page 6: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Camera Modification• Single wavelength conversion • Full spectrum conversion • Monochrome conversion

Dust reduction filter

Sensor

IR blocking filter

Microlens

Blue color filter

Photodiode and Silicon Substrate

Modified Consumer Digital Camera

Page 7: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Camera Characterization

7

Spectral Response • Spectral response showed

higher sensitivity in the shorter wavelengths

2D Image Quality • RAW processing workflow that accounts for the camera modification

• Residual pixel-level pattern

• Increased noise

• Increased effective resolution but risk of aliasing

Page 8: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Wavelength selection Object materials

& Optical Properties

Camera Sensitivity

Filter Transmission

Illumination Output (SPD)

Page 9: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Depth of Field and Sharpness Depth of field is not well defined for 3D reconstruction

f/5.6 f/11 f/32

Page 10: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Work to Quantify Effective Depth of Field • Linking 2D image quality assessment to 3D reconstruction

Page 11: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific
Page 12: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

• Permissible blur:

• FADGI star rating requires smaller value

• 3D reconstruction tolerates larger value

• Test object is not representative of heritage objects

Page 13: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Summary

Wavelength selection with the modified camera• Increase local contrast to improve 3D reconstruction

Understanding depth of field for 3D reconstruction • Increase sharpness to improve 3D reconstruction

Camera Characterization

Linking 2D image quality to 3D reconstruction

Page 14: Integrating Spectral and 3D Imaging for Monitoring ...€¦ · Integrating Spectral and 3D Imaging for Monitoring Heritage Objects E. Keats Webb. Conservation Documentation Scientific

Acknowledgements Museum Conservation Institute

Robert Koestler, DirectorPaula DePriest, Deputy Director

Smithsonian American Art MuseumAmber Kerr, Chief of ConservationHelen Ingalls, Retired Objects ConservatorAriel O’Connor, Objects Conservator

University of Brighton Roger Evans, Reader

University College LondonStuart Robson, Professor of Photogrammetry and

Laser Scanning Lindsay MacDonald, Honorary ProfessorDanny Garside, PhD StudentBen Sargeant, PhD Student

Analytik LtdIan Laidlaw, Managing Director & Founder