SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale...
Transcript of SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale...
![Page 1: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/1.jpg)
SpatialVx
Eric Gilleland Weather Systems Assessment Program
Research Applications Laboratory
2016 MesoVICT Workshop Wednesday, 21 September 2016
![Page 2: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/2.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
http://www.ral.ucar.edu/projects/icp/SpatialVx/ http://www.r-project.org
![Page 3: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/3.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Field Significane
Simulation-based field significance testing
spatbiasFS, LocSig,MCdof
Contributed by Kim Elmore
?
Spatial Prediction Comparison Test (SPCT)
Hypothesis test (CI’s) for competing forecasts that accounts for spatial dependence
spctlossdiffempiricalVG.lossdiffflossdiffsummary
Assistance from Amanda Hering
Yes
Significance Testing
![Page 4: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/4.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx Significance Testing
![Page 5: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/5.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Fractions Skill Score (FSS)
Compares event frequencies within neighborhoods
hoods2d Makes use of fft from R package stats.
Yes
Most other neighborhood methods
see Ebert (2008, Meteorol. Appl., 15, 51 - 64. DOI: 10.1002/met.25)
hoods2dpphindcast2dupscale2d
Some
Wavelet de-noising Smoothing by way of wavelet denoising
wavePurifyVx Uses waveslim package by Brandon Whitcher
Yes
Low-pass Filtering / Neighborhood Methods
![Page 6: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/6.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Intensity Scale (IS), Wavelet Details
Summary measures of wavelet detail fields
waveISwaverify2d
Uses waveslim package
Some
Structure Function Variability/structure at different spatial lags
structurogramstructurogram.matrixvariogram.matrix
Heavy copying of vgram.matrix from fields package by Doug Nychka et al.
Some
Band-pass Filtering / Scale Separation
Very good, recent review paper about wavelet spatial verification methods (+ a new proposed technique): Weniger, M., F. Kapp, and P. Friederichs, 2016: Spatial Verification Using Wavelet Transforms: A Review. arXiv preprint arXiv:1605.03395
![Page 7: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/7.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Binary Image Metrics
Distance map based summary measures
locmeasures2dlocperf
Uses distmap, deltametric, and other functions from R package spatstat.
Some
Forecast Quality Index (FQI)
Image metric that accounts for intensity differences as well as displacmeents
FQI No
Displacement measures
![Page 8: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/8.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Zhu’s metric linear combination of
two measures: (i) the amount of overlap between events in two fields and (ii) the mean error distance
metrV Yes
Image Moments Summary information for an object or field, e.g. centroid, orientation angle, etc.
imomenter Yes
Displacement measures (continued)
![Page 9: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/9.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Optical Flow (OF) Deform forecast
using gradients OF Contributed
by Caren Marzban
No
Rigid transformation
Deform forecast using translations and/or rotations only
rigiderrigidTransform
Needs more
Field Displacement
![Page 10: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/10.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx Name Functions Notes Tested Identify Features FeatureFinder Uses
connected function from R package spatstat
Yes
Merge/Match Features
centmatchminboundmatchdeltammMergeForce
Some
Analyzing Features
FeatureMatchAnalyzerFeatureAxisFeaturePropsFeatureCompsFeatureTable
Some
Feature-based
![Page 11: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/11.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx Name Description Functions Notes Tested Cluster Analysis Use statistical
cluster analysis to define features
clustererCSIsamples
CSIsamples contributed by Caren Marzban
Some and ?
Contiguous Rain Area (CRA)
Use rigid transformation and breakdown RMSE
craer No
Structure Amplitude Location (SAL)
Distributional comparisons of identified features
saller Some
Composite Distributions of features
compositer No
Shape Analysis Reduce features to landmark points describing their shape
hiwdistillsummary
Obtains landmarks (tricky) for use with shapes package
Yes, but …
Feature-based (cont.)
![Page 12: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/12.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx Feature-based
X (feature 1) Xhat (feature 1)
Observed Feature
Forecast Feature
Shape Analysis
![Page 13: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/13.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx
Name Description Functions Notes Tested Method for Object-based Diagnostic Evaluation (MODE)
MODE-type analysis interester Minimal
Feature-based (cont.)
![Page 14: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/14.jpg)
UCAR Confidential and Proprietary. © 2008, University Corporation for Atmospheric Research. All rights reserved.
Name Description Functions Notes Tested Geometric Indices
Summarizes shapes and texture within a field
Cindex, Sindex and Aindex
Yes
SpatialVx
Field Patterns / Texture
Aindex and Sindex useful for single objects too. See also variogram and variogram.matrix for analyzing field texture. New wavelet method, but not in SpatialVx (so far!)
AghaKouchak et al. (2011, doi:10.1175/2010JHM1298.1)
![Page 15: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/15.jpg)
UCAR Confidential and Proprietary. © 2016, University Corporation for Atmospheric Research. All rights reserved.
SpatialVx Name Description Functions Notes Tested Anomaly Correlation Coefficient
Correlation using a climatology instead of the mean
ACC Some
Bias-adjusted Gilbert Skill Score
Accounts for spatial bias
vxstats Some
Gaussian Mixture Models (GMM)
Fitted parameters inform about displacement errors
gmm2d Very Slow
Yes
Geographic box plot
Box plots that account for grid box area differences
GeoBoxPlot Yes
S1 score Comparison of gradients between two fields
S1 No
Miscellaneous
![Page 16: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/16.jpg)
New User’s Group
UCAR Confidential and Proprietary. © 2008, University Corporation for Atmospheric Research. All rights reserved.
https://www.linkedin.com/groups/8550343
![Page 17: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/17.jpg)
Future Plans • Finish/Start Testing all functions • Get all functions in-line with general
methods for functions • Methods Needing to be Added
§ Image Warping § Optical Flow/DAS (Keil and Craig) § Newly Proposed Methods § New modifications of FSS § Other?
• Write a tutorial
UCAR Confidential and Proprietary. © 2008, University Corporation for Atmospheric Research. All rights reserved.
![Page 18: SpatialVxericg/Talks/GillelandSpatialVxTalk... · 2016. 9. 23. · Band-pass Filtering / Scale Separation Very good, recent review paper about wavelet spatial verification methods](https://reader034.fdocuments.in/reader034/viewer/2022052101/603b1edabc836e0d7d48c363/html5/thumbnails/18.jpg)
Questions?
Thank you to those who have been testing functions from the package. It is nice to have the help! It is always appreciated to have bugs and other errors identified
UCAR Confidential and Proprietary. © 2008, University Corporation for Atmospheric Research. All rights reserved.