Towards Near Daily Monitoring of Inundated Areas over...

30
Towards Near Daily Monitoring of Inundated Areas over North America through Multi-Source Fusion of Optical and Radar Data Chengquan Huang 1 , Ben DeVries 1 , Wenli Huang 1 , Jiaming Lu 1 , Megan Lang 2 , John Jones 3 , Irena Creed 4 , Jennifer Dungan 5 , Andrew Michaelis 5 , Ramakrishna Nemani 5 1 Department of Geographical Sciences, University of Maryland; 2 US Fish and Wildlife Service National Wetland Inventory; 3 US Geological Survey; 4 University of Western Ontario; 5 NASA Ames Research Center NASA LCLUC Science Team Meeting, Rockville, MD, April 12 – 14, 2017

Transcript of Towards Near Daily Monitoring of Inundated Areas over...

Page 1: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Towards Near Daily Monitoring of Inundated Areas over North America through Multi-Source Fusion of

Optical and Radar Data

Chengquan Huang 1, Ben DeVries 1, Wenli Huang 1, Jiaming Lu 1, Megan Lang 2, John Jones 3, Irena Creed 4, Jennifer Dungan 5, Andrew Michaelis 5, Ramakrishna Nemani 5

1 Department of Geographical Sciences, University of Maryland; 2 US Fish and Wildlife Service National Wetland

Inventory; 3 US Geological Survey; 4 University of Western Ontario; 5 NASA Ames Research Center

NASA LCLUC Science Team Meeting, Rockville, MD, April 12 – 14, 2017

Page 2: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Need for Inundation Monitoring• Surface inundation plays important roles in Earth system processes

• land-atmosphere energy balance (Krinner 2003), • carbon and nutrient cycles (Shindell et al. 2005; Fox et al. 2014; McDonough et al. 2014), • surface – groundwater dynamics (Winter 1999; Becker 2006).

• Wetlands and other intermittently inundated areas provide a range of ecosystem services • water purification, • climate and flood regulation, • natural hazards, food and fiber, and recreation (Millennium Ecosystem Assessment 2005),• Biodiversity (Millennium Ecosystem Assessment 2005).

• Aquatic ecosystems are being lost at alarming rates (Millennium Ecosystem Assessment 2005). • Pressure from a growing human population • Climate change

• Inundation affects human welfare• Water availability (e.g. for human consumption)• Water-borne diseases• Flooding

Page 3: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Need for High Spatial Resolutions

(Verpoorter et al. 2014)(Downing 2006)

Page 4: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Coarse

Growing Number of Global Water Datasets

Temporal resolution

Spat

ial R

esol

utio

n

Single-date Daily, Long-term

Fine

Feng et al.; Chen et al.

Klein et al.Carroll et al.

Lehner and Döll

Yamazaki et al.

Prigent et al.

Schroeder et al.

Westerhoff et al.

Verpoorter et al.

SWBD

Pekel et al.

(Schroeder et al. 2015)

• Daily• 25 km

(Feng et al. 2015)• 2000• 30 m

(Pekel et al. 2015)• Monthly to

annual• 30 m

Page 5: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Limitations of Water Classifications

Prairie Pothole Region (Saskatchewan, Canada)

Max extent classification,1985-2010 (Pekel et al. 2015)

Subpixe water fraction (This study)

Page 6: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Inundation Highly Variable Over Time

Inundation Probability in Different Seasons over the Last Three Decades over the Everglades

Page 7: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Research Objectives• Develop and demonstrate improved capability to monitor terrestrial

inundation • Develop automated algorithms suitable for inundation monitoring at the global scale

using Landsat-8/Sentinel-2 (L8S2) optical data and Sentinel-1 (S1) SAR data. • Water/non-water classification• Subpixel Water Fraction (SWF)

• Calibrate and test extensively • Test sites in US, Canada, Europe, Australia

• Generate near daily inundation products for United States and southern Canada

Page 8: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Landsat 8, Sentinel 2 Sentinel 1

OPTICAL DATA SAR DATA

Integration

Final Inundation Product

Water/Non-water classification

Subpixel Water Fraction

Water/Non-water classification

Subpixel Water Fraction

Classification algorithms

Subpixel estimation algorithms

1. DSWE2. Index/thresholding3. Machine learning: SVM, RF

Optical-SAR Integration• Cross-sensor calibration• Time series statistics (e.g.

inundation probability)

Classification algorithms

1.Regression Trees2.Self-training

Subpixel estimation algorithms

Overall Approach

Automation key to near daily monitoring at continental to global scales.

Page 9: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Inundation Mapping Driven by Lidar Based Training Data

(Huang et al. 2014)

Page 10: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Dynamic Surface Water Extent (DSWE) Classification Algorithm for L8/S2

• DSWE tests:1. MNDWI > 123 [scaled by 10000]2. MBSRV > MBSRN3. AWEsh > 04. MNDWI > -5000* & SWIR1 < 1000 & NIR < 15005. MNDWI > -5000 & SWIR2 < 1000 & NIR < 2000

𝑀𝑀𝑀𝑀𝑀𝑀𝑀𝑀𝑀𝑀 =𝐺𝐺 − 𝑆𝑆𝑀𝑀𝑀𝑀𝑆𝑆𝑆𝐺𝐺 + 𝑆𝑆𝑀𝑀𝑀𝑀𝑆𝑆𝑆

𝑀𝑀𝑀𝑀𝑆𝑆𝑆𝑆𝑀𝑀 = 𝐺𝐺 + 𝑆𝑆

𝑀𝑀𝑀𝑀𝑆𝑆𝑆𝑆𝑀𝑀 = 𝑀𝑀𝑀𝑀𝑆𝑆 + 𝑆𝑆𝑀𝑀𝑀𝑀𝑆𝑆𝑆

𝐴𝐴𝑀𝑀𝐴𝐴𝑆𝑆𝐴𝐴 = 𝑀𝑀 + 2.5𝐺𝐺 − 𝑆.5𝑀𝑀𝑀𝑀𝑆𝑆𝑆𝑆𝑀𝑀 − 0.25𝑆𝑆𝑀𝑀𝑀𝑀𝑆𝑆2(Jones 2015)

Page 11: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Subpixel Water Fraction Algorithm

SR bands (30m)

Classified map:- water, non-water,

partial water

Initial SWF:- water = 1- non-water = 0- partial water ϵ [0,1]

SR bands (150m)

SWF (150m)

classify

assign SWF

aggregate*

aggregate

fit model(150m)

predict(30m)

predict(30m)

fit model(150m)

aggregate

MODEL

SWF (30m)

SWF (30m)

Previous iteration

Difference between two consecutive runs

N

Y

convergence?

Final SWF (30m)

0 1

0.64

*aggregate All subsequent iterations

(Based on Rover et al. 2010)

Page 12: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

PPR

DEL

EVE

Saskatchewan Prairie Pothole (PPR)• small seasonal and ephemeral ponds

fed by snowmelt in early spring and late summer storms

• airborne LiDAR, field surveys

Delmarva Peninsula (DEL)• depressional wetlands (bays), flats and

forested wetlands in riparian zones• airborne LiDAR

Florida Everglades (EVE)• wet prairie and sawgrass marsh,

evergreen forest, mangrove, rush• water level gauges, local DEM

Initial Test Sites

Page 13: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Continuous Water Level Measurements Over the Everglades

Page 14: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Time Series SWF Tracks Ground Observations

Page 15: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

2007-03-29 2009-03-18

SWF

LiDA

RLi

DAR

-SW

F

04/2008RMSE = 15% RMSE = 11%

Comparison with Lidar Based Reference Data

2007-03-27 2009-03-24

Page 16: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

1 2

3 4

5

• Pond perimeters delineated in late spring / early summer of 2005

• Purpose: establishing transects for multi-temporal soil moisture measurements

• Smaller ponds (classes 1-3) likely do not represent inundated area (probably ‘potential’ inundated surface)

Pond Classes (Carlyle 2006)

Pond Area Estimation Over Saskatchewan PPR

Page 17: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

2005-04-25

2005-05-11

4

5

Photos: Stephen Carlyle (2006)

Pond Area Estimation Over Saskatchewan PPR

Page 18: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

18

Penetration through heavy rainfall in C-and L-band

SIR-C/X-SAR Images of a Portion of Rondonia, Brazil, April 10, 1994

Cloud Is A Major Problem in Optical Observations, But Far Less in SAR Data

(Zhong Lu)

Page 19: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Water Signal Highly Variable in RadarOpen water

Open water with waves

Water with vegetation

Dark soil / agriculture

GoogleEarth: 2014-02Sentinel-1 VH: 2015-03-13GoogleEarth: 2014-12Sentinel-1 VV: 2015-03-17

GoogleEarth: 2015-05Sentinel-1 VV: 2016-05-06 GoogleEarth: 2014-12Sentinel-1 VH: 2014-11-13

Page 20: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Sentinel-1 SAR Water Extent Mapping

ϒ⁰ = Gamma naught, α = Incidence angle*Prior Mask: DSWE=Dynamic Surface Water Extent, Multi-temporal class probability

PROB >= 0.3

Terrain Flatten ϒ⁰

DEM (SRTM)S1A

VV, VH

Radiometric Calibration to β⁰

Sigma Lee Filter (5x5)

Gamma0 (ϒ⁰)

LocalIncidence Angle (α)

VV < -26dB Data Noise

Settlement AreaVV > 1 dB

PriorMask*

Y

Y

A1. SAR Data Pre-processing

A2. SAR Data Filtering

ϒ⁰ Index

Water probability[0, 1]

B. Machine Learning

Terrain Corrected Geocoded ϒ⁰ Local

Incidence Angle (α)

Multilook (3x3)

C. Threshold-based Water Extent Mapping

PROB >= 0.6

Water(1)

Y

PROB >= 0.5

Partial Water

High (2)Y

N

Y

Land (0)

Partial Water

Low (3)

N

N

Page 21: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Mapping Algorithm 1: Machine Learning Approach

Multi-Year Landsat Images

Multi-Year Water/non-

water classifications

Always inundated areas (water

training samples)

Never inundated areas (non-water training samples)

DSWE Temporal Analysis

Inundation product

Image to be mapped

Machine Learning and

Prediction

Page 22: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

A. Multi-year land probability

B. Multi-year water probability

C. Highly confident (>95%) training samples

Training Data Derivation Using Multi-Temporal DSWE Products

Page 23: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

RF_DSWE: Class 2015-03-17

Google Earth 2013-10-20

RF_DSWE: Prob. 2015-03-17

Machine Learning Approach Over Delmarvar

Page 24: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

S1 Radar Mapping Over Everglades

Page 25: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

S1 Radar Mapping Over Saskatchewan Prairie Pothole Region

Page 26: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Inundation change over time

Prototype Inundation Time Series from L8/S2/S1

5 km

Everglades

Page 27: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Prototype Inundation Time Series from L8/S2/S1

Page 28: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Large Area Prototype Over North Dakota• Entire state• All images available from 04/01/2016 to 10/31/2016• Landsat 8

• 234 images• Order and SR/cloud mask: ~3 days• Mapping: ~30 h x 10 CPUs

• Sentinel-2• 841 granules• SR/cloud mask: ~28 h x 10 CPUs• Mapping: ~35 h x 10 CPUs

• Sentinel-1• 59 images• Preprocessing: ~36 h• Mapping: ~6 h

Page 29: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Large Area Prototype Over North Dakota

Repeat intervals: 1 – 16 days

Page 30: Towards Near Daily Monitoring of Inundated Areas over ...lcluc.umd.edu/sites/default/files/inundation_huang2017v1.pdf · Towards Near Daily Monitoring of Inundated Areas over North

Summary

• Automated surface water mapping algorithms developed

• Optical methods• Mature for Landsat• A manuscript ready for submission• Some adjustment needed for S2

• Radar methods• Tested over multiple sites• Need more quantitative assessment

• Limited validation possible• High resolution data for determining

subpixel fraction • Temporal matching critical• Gauge data with good DEM desirable

• Initial large area test over ND • Tried all available L8, S2, S1 images for

summer 2016• Preprocessing time >> mapping time• Huge saving if preprocessed data

available• Optical data: at least 50%• Radar: > 80%

• Next steps• Try out HLS data• Ensure optical-radar consistency • Develop more validation data sets• Scale up to US and Southern Canada• Analyze regional/national results