Automated Boulder Detection and Measuring in HiRISE images · as observed by landers and rovers,...

1
1: Louisiana State University Geology and Geophysics, Planetary Science Lab, 2: NASA Marshall Space Flight Center 3: University of Washington Earth and Space Sciences & Astrobiology, Introduction Methodology Application Performance and Verification Acknowledgements & References Automated Boulder Detection and Measuring in HiRISE images Don R. Hood1 ([email protected]) , S. Karunatillake1, C.I. Fassett2, S.F. Sholes3 Images taken by the High Resolution Imaging Science Experiment (HiRISE) show that meter-scale boulders, as observed by landers and rovers, are present across the entire surface of Mars [1], [2]. Quantifying esti- mates of these boulder populations, including their size and location, can inform Martian pedogenesis, surface weathering, impact processes, and mass wast- ing processes [3], [4]. However, manual measurement of boulder populations is time intensive, and cannot be applied at large scales (e.g. more than a few square km of surface area). To facilitate this, we have devel- oped a Python-based algorithm to automatically iden- tify, locate, and measure boulders on the martian sur- face. This set of tools and programs is collected in a python library called the Martian Boulder Automatic Recognition System: MBARS. This is designed as a pub- licly available (via online source e.g. GitHub) toolset to enable science and allow modification and improve- ment by the larger community. Modeled after method in Golombek 2008 [1] Shadowed areas identified via intensity thresholding (Figure 2,4) Shadows outlined via watershed [6] Ellipses fit with Orthogonal Distance Regression (Figure 3,5) Boulder width and height interpreted from shadow geometry (Figure 3) MBARS aids in scientific investigation of martian surface processes: o Boulder clustering on periglacial terrain [4] o Boulder erosion and weathering [3], [7] o Impact ejecta studies [8] Landing site characterization and terrain recognition Planned application to lunar images This work is supported by the Louisiana Space Consor- tium Graduate Student Research Assistantship and Re- search Enhancement Award (Grant #NNX15AH82H). Thanks to and the American Association of Petroleum Geologists for supporting my travel to present this work. In addition, thanks to Nicki Button, Glendon Re- werts, and Ashley Hood for their contribution to this project and to this poster presentation. On 16 GB, 4 Core 3.6 GHz processor, full image processes in ~10 hours Handles data errors smoothly Algorithm tested against existing datasets: o Measurements by other algorithms [1], [2] o Manual measurements (Figure 6,7) o Objects of known size (landers, rovers, and measured rocks) 3 sections of PSP_007718_2350 are main test dataset Testing emphasizes accuracy with populations and individual objects Cumulative Fractional Area, Size-Frequency distributions: key population comparators Abstract #2437 Partitioning: Improves speed, user can control level of partitioning Gamma Filter: Stretches low- value pixels, precise sampling of pen- umbra, low gamma = intense stretch Rotate Image: Orienting image in sun direction simplifies ellipse fitting Separate Shadows: Shadows identified, merged shadows are split Fit shadows: Method shown in figure 3, results in Figure 5 Boulder measure: Boulder widths and heights are measured, stored for later analysis (Figure 6,7) Algorithm Workflow MBARS tends to miss smaller boulders and overestimate boulder diameters False positives not observed in images Comparison with published algorithms promising Will fully explore parameter space to identify most accurate settings Cut processing time down to <1 hour o Parallelization is key step Conclusions & Future Work [1] M. P. Golombek, et. al., “Size-frequency distributions of rocks on the northern plains of Mars with special reference to Phoenix landing surfaces,” JGR, Jul. 2008. [2] M. P. Golombek, et. al, “Detection and Characterization of Rocks and Rock Size-Frequency Dis- tributions at the Final Four Mars Science Laboratory Landing Sites,” Int. J. Mars Sci. Explor., 2012. [3] T. de Haas, et. al, “Local late Amazonian boulder breakdown and denudation rate on Mars,” GRL, 2013. [4] T. C. Orloff, et. al, “Boulder movement at high northern lati- tudes of Mars,” JGR, Nov. 2011. [5] P. T. Boggs, et. al, “User’s Reference Guide for ODRPACK Version 2 . 01 Software for Weighted Orthogonal Distance Regression,” U.S. Dep. Commer., June, p. 99, 1992. [6] R. Barnes, et. al, “Priority-flood: An optimal depression- filling and watershed-labeling algorithm for digital elevation models,” Comput. Geosci., 2014. [7] M. P. Golombek and N. T. Bridges, “Erosion rates on Mars and implications for climate change Constraints from the Pathfinder landing site,”, 2000. [8] N. Krishna and P. S. Kumar, “Impact spallation processes on the Moon: A case study from the size and shape analysis of ejecta boulders and secondary craters of Censorinus crater,” Icarus, 2016. [9] H. J. Moore and J. M. Keller, “Surface-material maps of Viking landing sites on Mars,” A Bibli- ogr. Planet. Geol. Geophys. Princ. Investig. their Assoc. 1990-1991, 1991. Figure 5. The origi- nal image with shadow ellipses (green) and boulder diameters (blue) overlain. The shadow geometry in figure 3 is assumed here, so boulders lie at the center of the shadow ellipse. The inset highlights the ability of the watershed method to split merged shadows, accurately separating the continuous shadowed area. Figure 4. A seg- mented version of the image above with the same orien- tation and scale. Areas of the image above the shadow boundary deter- mined earlier are mapped to a single value while the pixels below the value are un- altered. This image feeds into our watershed method-based shadow identification method. Seeds for watershed are deter- mined by local minima in the shadows, which helps split merged shadows. This and the remaining images show results using a gamma value of 0.7 and boundary of 0.1 Figure 1. A subset of HiRISE image PSP_007718_2350 (called PSP_007718_ 2350_10) rotated so that the sun is ori- ented downward in the image and North is to the lower right. This image is in rocky area in Acidalia Planitia, with low topogra- phy and abundant rocks, an ideal test target for MBARS. The image inset is ~30m across and used in all following images. Input image Image Metadata (Resolution, Sun Direction, Sun Angle) Partitioning Gamma-filtering Identify Shadow Boundary Segmentation Separate shadows Fit shadows Measure Boulders 0.0001 0.001 0.01 0.1 1 0.5 5 a e r A l a n o i t c a r F e v i t a l u m u C Boulder Diameter (m) Cumulave Fraconal Area for PSP_007718_2350_10 gamma=0 .7, bound=0.01 gamma=0.7, bound=0.1 PSP_007718_2350_10 gamma=0.6, bound=0.1 gamma=0.6, bound=0.01 0 0.01 0.02 0.03 0.04 0.05 0.06 0.5 1 1.5 2 2.5 3 3.5 4 4.5 5 2 ^ m r e p y c n e u q e r F Boulder Diameter (m) Size-Frequency Distribuon for PSP_007718_2350_10 PSP_007718_2350_10 gamma=0.6, bound=0.1 gamma=0.6, bound=0.01 gamma=0.7, bound=0.01 gamma=0.7, bound=0.1 Illumination Direction Shaded Area Ellipse of ideal shadow Shadow Boundary Points Mirrored Points Boulder Boulder width Shadow Length Rotate Image 25m N 25m N 25m N Figure 2. We determine the “shadow intensity” based on a gauss- ian fit to the image intensity histogram. We fit a gaussian (green stars) to the image histogram (blue line) and select a boundary based on the fit. The user sets a fraction (say .01) to select as the boundary, the program calculates the intensity where the fit fre- quency equals that fraction of its maximum value. Larger frac- tions include more pixels as ‘shadowed’, increasing estimated boulder size. Figure 3. Our model geometry for individual boulders and fitting method. On flat ground with the sun coming from the north, a spheroidal boulder casts a half-elliptical shadow (umbra+penumbra) where the minor axis is equal to the boulder diameter and the semi-major axis deter- mined by the boulder height. We mirror points along the shadow boundary (white stars) across the sunward end of the shadow to map the outline of the full ellipse (red stars). Figure 6. A size-frequency distribution for manual and automated results for PSP_007718_2350, showing the area-normalized fre- quency of boulders depending on their diameter. The manual data is shown in red, labeled as PSP_007718_2350_10, and automated results are named according to their running parameters gamma and bound. This clearly shows the tendency of MBARS to underesti- mate the abundance of small boulders and overestimate the abun- dance of larger boulders. Figure 7. A cumulative fractional area plot for manual and auto- mated results for PSP_007718_2350, showing the total fractional area of all boulders above a given diameter. The manual data is shown in red, labeled as PSP_007718_2350_10, and automated re- sults are named according to their running parameters “gamma” and “bound”. The effect of changing these running parameters is appar- ent here, with estimated boulder size increasing with higher bound and with decreasing with higher gamma. Pixel Intensity Frequency Gamma Filtered Image Histogram Gaussian Fit to Image Shadow Boundary Shadows Image Histogram

Transcript of Automated Boulder Detection and Measuring in HiRISE images · as observed by landers and rovers,...

Page 1: Automated Boulder Detection and Measuring in HiRISE images · as observed by landers and rovers, are present across the entire surface of Mars [1], [2]. Quantifying esti-mates of

1: Louisiana State University Geology and Geophysics, Planetary Science Lab, 2: NASA Marshall Space Flight Center 3: University of Washington Earth and Space Sciences & Astrobiology,

Introduction

Methodology

Application

Performance and Veri�cation

Acknowledgements & References

Automated Boulder Detection and Measuring in HiRISE imagesDon R. Hood1 ([email protected]) , S. Karunatillake1, C.I. Fassett2, S.F. Sholes3

Images taken by the High Resolution Imaging Science Experiment (HiRISE) show that meter-scale boulders, as observed by landers and rovers, are present across

the entire surface of Mars [1], [2]. Quantifying esti-mates of these boulder populations, including their size and location, can inform Martian pedogenesis,

surface weathering, impact processes, and mass wast-ing processes [3], [4]. However, manual measurement of boulder populations is time intensive, and cannot

be applied at large scales (e.g. more than a few square km of surface area). To facilitate this, we have devel-

oped a Python-based algorithm to automatically iden-tify, locate, and measure boulders on the martian sur-

face. This set of tools and programs is collected in a python library called the Martian Boulder Automatic

Recognition System: MBARS. This is designed as a pub-licly available (via online source e.g. GitHub) toolset to enable science and allow modi�cation and improve-

ment by the larger community.

• Modeled after method in Golombek 2008 [1]• Shadowed areas identified via intensity thresholding (Figure 2,4)• Shadows outlined via watershed [6]• Ellipses fit with Orthogonal Distance Regression (Figure 3,5)• Boulder width and height interpreted from shadow geometry (Figure 3)

• MBARS aids in scientific investigation of martian surface processes: o Boulder clustering on periglacial terrain [4] o Boulder erosion and weathering [3], [7] o Impact ejecta studies [8]• Landing site characterization and terrain recognition• Planned application to lunar images

This work is supported by the Louisiana Space Consor-tium Graduate Student Research Assistantship and Re-search Enhancement Award (Grant #NNX15AH82H). Thanks to and the American Association of Petroleum Geologists for supporting my travel to present this work. In addition, thanks to Nicki Button, Glendon Re-werts, and Ashley Hood for their contribution to this project and to this poster presentation.

• On 16 GB, 4 Core 3.6 GHz processor, full image processes in ~10 hours• Handles data errors smoothly• Algorithm tested against existing datasets: o Measurements by other algorithms [1], [2] o Manual measurements (Figure 6,7) o Objects of known size (landers, rovers, and measured rocks)• 3 sections of PSP_007718_2350 are main test dataset• Testing emphasizes accuracy with populations and individual objects• Cumulative Fractional Area, Size-Frequency distributions: key population comparators

Abstract #2437

• Partitioning: Improves speed, user can control level of partitioning

• Gamma Filter: Stretches low-value pixels, precise sampling of pen-umbra, low gamma = intense stretch

• Rotate Image: Orienting image in sun direction simpli�es ellipse �tting

• Separate Shadows: Shadows identi�ed, merged shadows are split

• Fit shadows: Method shown in �gure 3, results in Figure 5

• Boulder measure: Boulder widths and heights are measured, stored for

later analysis (Figure 6,7)

Algorithm Work�ow

• MBARS tends to miss smaller boulders and overestimate boulder diameters• False positives not observed in images• Comparison with published algorithms promising• Will fully explore parameter space to identify most accurate settings• Cut processing time down to <1 hour o Parallelization is key step

Conclusions & Future Work

[1] M. P. Golombek, et. al., “Size-frequency distributions of rocks on the northern plains of Mars with special reference to Phoenix landing surfaces,” JGR, Jul. 2008. [2] M. P. Golombek, et. al, “Detection and Characterization of Rocks and Rock Size-Frequency Dis-tributions at the Final Four Mars Science Laboratory Landing Sites,” Int. J. Mars Sci. Explor., 2012. [3] T. de Haas, et. al, “Local late Amazonian boulder breakdown and denudation rate on Mars,” GRL, 2013. [4] T. C. Orloff, et. al, “Boulder movement at high northern lati-tudes of Mars,” JGR, Nov. 2011. [5] P. T. Boggs, et. al, “User’s Reference Guide for ODRPACK Version 2 . 01 Software for Weighted Orthogonal Distance Regression,” U.S. Dep. Commer., June, p. 99, 1992. [6] R. Barnes, et. al, “Priority-�ood: An optimal depression-�lling and watershed-labeling algorithm for digital elevation models,” Comput. Geosci., 2014. [7] M. P. Golombek and N. T. Bridges, “Erosion rates on Mars and implications for climate change Constraints from the Pathfinder landing site,”, 2000. [8] N. Krishna and P. S. Kumar, “Impact spallation processes on the Moon: A case study from the size and shape analysis of ejecta boulders and secondary craters of Censorinus crater,” Icarus, 2016. [9] H. J. Moore and J. M. Keller, “Surface-material maps of Viking landing sites on Mars,” A Bibli-ogr. Planet. Geol. Geophys. Princ. Investig. their Assoc. 1990-1991, 1991.

Figure 5. The origi-nal image with shadow ellipses

(green) and boulder diameters (blue)

overlain. The shadow geometry in �gure 3 is assumed here, so boulders lie at the center of the shadow ellipse. The inset highlights the ability

of the watershed method to split merged shadows, accurately separating the continuous shadowed area.

Figure 4. A seg-mented version of the image above

with the same orien-tation and scale.

Areas of the image above the shadow boundary deter-mined earlier are

mapped to a single value while the pixels below the value are un-altered. This image feeds into our watershed method-based

shadow identi�cation method. Seeds for watershed are deter-mined by local minima in the shadows, which helps split merged

shadows. This and the remaining images show results using a gamma value of 0.7 and boundary of 0.1

Figure 1. A subset of HiRISE image

PSP_007718_2350 (called PSP_007718_ 2350_10) rotated so that the sun is ori-

ented downward in the image and North is to the lower right. This image is in rocky area in Acidalia Planitia, with low topogra-

phy and abundant rocks, an ideal test target for MBARS. The image inset is ~30m across and used in all following images.

Input image

Image Metadata(Resolution, Sun Direction,

Sun Angle)

Partitioning

Gamma-�ltering

Identify Shadow Boundary

Segmentation

Separate shadows

Fit shadows

Measure Boulders

0.0001

0.001

0.01

0.1

1

0.5 5

aerA lanoitcarF evitalumuC

Boulder Diameter (m)

Cumula�ve Frac�onal Area for PSP_007718_2350_10

gamma=0 .7, bound=0.01gamma=0.7, bound=0.1PSP_007718_2350_10gamma=0.6, bound=0.1gamma=0.6, bound=0.01

0

0.01

0.02

0.03

0.04

0.05

0.06

0.5 1 1.5 2 2.5 3 3.5 4 4.5 5

2^m rep ycneuqerF

Boulder Diameter (m)

Size-Frequency Distribu�on for PSP_007718_2350_10

PSP_007718_2350_10

gamma=0.6, bound=0.1

gamma=0.6, bound=0.01

gamma=0.7, bound=0.01

gamma=0.7, bound=0.1

Illumination Direction

Shaded Area

Ellipse of ideal shadow

Shadow Boundary Points

Mirrored Points

Boulder

Boulder width

Shadow Length

Rotate Image

25m

N

25m

N

25m

N

Figure 2. We determine the “shadow intensity” based on a gauss-ian �t to the image intensity histogram. We �t a gaussian (green stars) to the image histogram (blue line) and select a boundary based on the fit. The user sets a fraction (say .01) to select as the boundary, the program calculates the intensity where the �t fre-

quency equals that fraction of its maximum value. Larger frac-tions include more pixels as ‘shadowed’, increasing estimated

boulder size.Figure 3. Our model geometry for individual boulders and fitting method. On flat ground with the sun coming from

the north, a spheroidal boulder casts a half-elliptical shadow (umbra+penumbra) where the minor axis is equal

to the boulder diameter and the semi-major axis deter-mined by the boulder height. We mirror points along the shadow boundary (white stars) across the sunward end of

the shadow to map the outline of the full ellipse (red stars).

Figure 6. A size-frequency distribution for manual and automated results for PSP_007718_2350, showing the area-normalized fre-

quency of boulders depending on their diameter. The manual data is shown in red, labeled as PSP_007718_2350_10, and automated results are named according to their running parameters gamma

and bound. This clearly shows the tendency of MBARS to underesti-mate the abundance of small boulders and overestimate the abun-

dance of larger boulders.

Figure 7. A cumulative fractional area plot for manual and auto-mated results for PSP_007718_2350, showing the total fractional area of all boulders above a given diameter. The manual data is

shown in red, labeled as PSP_007718_2350_10, and automated re-sults are named according to their running parameters “gamma” and “bound”. The effect of changing these running parameters is appar-ent here, with estimated boulder size increasing with higher bound

and with decreasing with higher gamma.

Pixel Intensity

Freq

uenc

y

Gamma FilteredImage Histogram

Gaussian Fit toImage

Shadow Boundary

Shadows

Image Histogram