Zina Mitraka and Fabio Del Frate -...

1
The use of neural networks for non linear spectral unmixing over urban areas Zina Mitraka and Fabio Del Frate Earth Observation Lab, University of Rome Tor Vergata, Rome, Italy contact: [email protected] MUAS 2015 – November 45, 2015, Frascati, Italy Abstract The high spatial and spectral diversity of manmade structures and the 3D structure of the cities makes the mapping of urban surfaces using Earth Observation data one of the most challenging tasks of remote sensing field. Spectral unmixing techniques, although designed for and mainly used with hyperspectral data, they can be proven useful for use with medium spectral resolution data. The large spectral variability of urban structures imposes the use of multiple endmember spectral mixture analysis techniques, which are very demanding in terms of computation time. Moreover, the commonly used linear spectral mixture analysis approaches do not account for the multiple scattering of light between surfaces, which contributes significantly to the measured by the satellites reflectances in the urban canyons. In this study, a method is proposed to overcome these limitations, using an artificial neural network trained with endmember and nonlinearly mixed synthetic spectra to inverse the pixel spectral mixture in Landsat imagery. Urban Spectral Mixture Conclusions Study Area and Data This study presents a spectral unmixing approach using endmember and nonlinearly mixed synthetic spectra to estimate urban surface cover fraction from Landsat imagery; The 3D structure of cities imposes the use of nonlinear spectral mixture models to account for multiple reflections in the urban canyons; The estimated fractions were compared to higher resolution land cover information and a good agreement was observed, especially for the built up surface cover fraction; Neural networks’ quick and accurate performance makes them ideal to use for operational applications with the Copernicus Sentinels . Results Data Six cloudfree Landsat 7 Surface Reflectance Climate Data Record for 2011 High resolution (0.3 m) Land Cover information for 2011 Rome, Italy Validation ୀଵ where is the observed spectrum of pixel , is the representative spectrum of endmember , is the number of endmembers and is the contribution of endmember to the observed spectrum. , ୀଵ ୀଵ The first term accounts for linear mixing, while the second one accounts for multiple reflections of light between urban surfaces (Meganem et al., 2014). Urban Atlas Polygons of the study area of Rome, Italy. Dotted lined represent the validation area. Pseudo color composition of the fraction images, RGB: Nonurban bare, vegetation, builtup; water is background. Linear Mixing Model Quadratic Mixing Model Derived fraction image were compared to fractions from higher resolution land cover info Carbone, F. et al. (2015). A Citizen Science approach for the classification of VHR images in urban areas. In IGARSS 2015. Milano, Italy. Meganem, I. et al. (2014). Linearquadratic mixing model for reflectances in urban environments. IEEE Transactions on Geoscience and Remote Sensing, 52(1), 544–558. Okujeni, A. et al. (2013). Support vector regression and synthetically mixed training data for quantifying urban land cover. Remote Sensing of Environment, 137, 184–197. References Urban Surface Builtup Buildings/roofs Transportation areas Sport infrastructure Vegetation Green vegetation Nonphotosynthetic vegetation Nonurban bare surfaces Bare soil Rocks Water bodies Natural water bodies Swimming pools Builtup Vegetation Nonurban bare Water slope 1.074 0.974 0.622 1.208 intersect 0.043 0.007 0.027 0.028 R 2 0.686 0.777 0.105 0.812 MAE 0.152 0.097 0.073 0.053 RMSE 0.192 0.130 0.122 0.081 Dense Builtup Ottaviano Bare Surfaces Foro Romano Urban Vegetation Villa Borghese Water Surfaces Laghetto Villa Ada

Transcript of Zina Mitraka and Fabio Del Frate -...

Page 1: Zina Mitraka and Fabio Del Frate - due.esrin.esa.intdue.esrin.esa.int/muas2015/files/presentation63.pdf · Zina Mitraka and Fabio Del Frate Earth Observation Lab, University of Rome

The use of neural networks for non‐linear spectral unmixing over urban areas Zina Mitraka and Fabio Del FrateEarth Observation Lab, University of Rome Tor Vergata, Rome, Italy contact: [email protected]

MUAS 2015 – November 4‐5, 2015, Frascati, Italy 

AbstractThe high spatial and spectral diversity of man‐madestructures and the 3D structure of the cities makes themapping of urban surfaces using Earth Observationdata one of the most challenging tasks of remotesensing field. Spectral unmixing techniques, althoughdesigned for and mainly used with hyperspectral data,they can be proven useful for use with medium

spectral resolution data. The large spectral variabilityof urban structures imposes the use of multipleendmember spectral mixture analysis techniques,which are very demanding in terms of computationtime. Moreover, the commonly used linear spectralmixture analysis approaches do not account for themultiple scattering of light between surfaces, which

contributes significantly to the measured by thesatellites reflectances in the urban canyons. In thisstudy, a method is proposed to overcome theselimitations, using an artificial neural network trainedwith endmember and non‐linearly mixed syntheticspectra to inverse the pixel spectral mixture in Landsatimagery.

Urban Spectral Mixture 

Conclusions 

Study Area and Data 

› This study presents a spectral unmixing approachusing endmember and non‐linearly mixed syntheticspectra to estimate urban surface cover fractionfrom Landsat imagery;

› The 3D structure of cities imposes the use of non‐linear spectral mixture models to account formultiple reflections in the urban canyons;

› The estimated fractions were compared to higherresolution land cover information and a goodagreement was observed, especially for the built‐upsurface cover fraction;

› Neural networks’ quick and accurate performancemakes them ideal to use for operational applicationswith the Copernicus Sentinels.

Results 

Data 

› Six cloud‐free Landsat 7 Surface Reflectance Climate Data Record for 2011  

› High resolution (0.3 m) Land Cover information for 2011 

Rome, Italy

Validation 

where is the observed spectrum of pixel , is the

representative spectrum of endmember , is thenumber of endmembers and is the contribution

of endmember to the observed spectrum.

,

The first term accounts for linear mixing, while thesecond one accounts for multiple reflections of lightbetween urban surfaces (Meganem et al., 2014).

Urban Atlas Polygons of the study area of Rome, Italy. Dotted lined represent the validation area. 

Pseudo color composition of the fraction images, RGB: Non‐urban bare, vegetation, built‐up; water is background.

Linear Mixing Model 

Quadratic Mixing Model 

Derived fraction image were compared to fractions from higher resolution land cover info

Carbone, F. et al. (2015). A Citizen Science approach for the classification of VHR images in urban areas. In IGARSS 2015. Milano, Italy.

Meganem, I. et al. (2014). Linear‐quadratic mixing model for reflectances in urban environments. IEEE Transactions on Geoscience and Remote Sensing, 52(1), 544–558. 

Okujeni, A. et al. (2013). Support vector regression and synthetically mixed training data for quantifying urban land cover. Remote Sensing of Environment, 137, 184–197. 

References

Urban Surface

Built‐up 

Buildings/roofs 

Transportation areas 

Sport infrastructure 

Vegetation 

Green

 vegetation

Non‐photosynthetic 

vegetation 

Non‐urban bare 

surfaces 

Bare soil

Rocks 

Water bodies 

Natural w

ater bodies

Swimming pools

Built‐up Vegetation Non‐urban bare Waterslope 1.074 0.974 0.622 1.208intersect 0.043 ‐0.007 0.027 ‐0.028R2 0.686 0.777 0.105 0.812MAE 0.152 0.097 0.073 0.053RMSE 0.192 0.130 0.122 0.081

Dense Built‐up  Ottaviano

Bare Surfaces  Foro Romano

Urban Vegetation  Villa Borghese

Water Surfaces Laghetto Villa Ada