Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to...
Transcript of Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to...
![Page 1: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/1.jpg)
Comparative assessment of methods
to retrieve fine-scale ABL structures
from airborne measurements
L. Laiti1, D. Zardi1, M. de Franceschi1,2, G. Rampanelli1,3
1 Atmospheric Physics Group - Department of Civil, Environmental and Mechanical Engineering
University of Trento, Trento – Italy
corresponding author: [email protected]
21st Symposium on Boundary Layers and Turbulence 9-13 June 2014, Leeds – UK
![Page 2: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/2.jpg)
Outline of the talk
1. Airborne measurements of the ABL in a valley
2. The interpolation methods
3. Residual Kriging (RK)
4. Interpolation results
5. Objective cross validation
6. Modified cross validation
7. Conclusions
1
![Page 3: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/3.jpg)
1. Airborne measurements of the ABL in a valley
de Franceschi et al. (2003)
2
![Page 4: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/4.jpg)
1. Airborne measurements of the ABL in a valley
E crest level
W crest level
0600 UTC - PLAIN
flight #M
flight #N
flight #A
#M 0826-0923 UTC
#N 1126-1232 UTC
#A 1420-1505 UTC
ABL vertical structure 3
![Page 5: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/5.jpg)
1. Airborne measurements of the ABL in a valley
E crest level
W crest level
flight #M
flight #N
flight #A
#M 0826-0923 UTC
#N 1126-1232 UTC
#A 1420-1505 UTC
ABL vertical structure
0600 UTC - PLAIN
3
![Page 6: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/6.jpg)
1. Airborne measurements of the ABL in a valley
E crest level
W crest level
flight #M
flight #N
flight #A
#M 0826-0923 UTC
#N 1126-1232 UTC
#A 1420-1505 UTC
ABL vertical structure
0600 UTC - PLAIN
3
![Page 7: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/7.jpg)
1. Airborne measurements of the ABL in a valley
ABL fine-scale 2D/3D structure? 4
Potential temperature
![Page 8: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/8.jpg)
1. Airborne measurements of the ABL in a valley
flight trajectory
3D high-res regular grid
ABL fine-scale 2D/3D structure? 4
![Page 9: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/9.jpg)
1. Airborne measurements of the ABL in a valley
3D high-res regular grid
interpolation method? 4
flight trajectory
![Page 10: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/10.jpg)
1
N
j i j g i
j
qx x x x
Methods based on weighted averages:
• Distance weighting
• Delaunay triangulation
1
1
1
fori
i i gN
j
j
r
r
x x
2. The interpolation methods
2
2
1
expfor
exp
i
i i gN
j
j
r
r
x x
Inverse Distance Weighting Exponentially-Weighted Inverse Squared
IDW Distance- EWISD
Natural Neighbors - NN
• Geostatistical methods
Residual Kriging - RK
GEOMETRY
GEOMETRY GEOMETRY + COVARIANCE 5
= semivariogram function
Egger (1983) Hennemuth (1985)
Weigel and Rotach (2004)
ˆg i ii
x x 1ii
![Page 11: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/11.jpg)
3. Residual kriging (RK)
target variable = drift + residuals
i i i x x x
ˆg i ii
x x
2
1
1 1
2
N
i i
iN
h
h
h x x h
see Laiti et al. (2013) Atmos. Sci. Lett.
residual approach
6
ˆ ˆˆg g g x x x
ˆ g x
2 0ˆ g i i giq x x x
extraction of pseudo-
soundings by moving-window
vertical average
interpolation by Ordinary Kriging (Cressie, 1993)
byproduct: variance of estimates
semivariogram
h
homniI
![Page 12: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/12.jpg)
4. Interpolation results
• interpolation grid: 50x50x50 m3
7
![Page 13: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/13.jpg)
4. Interpolation results
• interpolation grid: 50x50x50 m3
residual approach
7
![Page 14: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/14.jpg)
4. Interpolation results
• interpolation grid: 50x50x50 m3
7
residual approach
![Page 15: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/15.jpg)
5. Objective cross validation
Leave One Out Cross Validation (LOOCV): exclusion of one observation at time
xi
8
![Page 16: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/16.jpg)
xi
8
5. Objective cross validation
Leave One Out Cross Validation (LOOCV): exclusion of one observation at time
![Page 17: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/17.jpg)
xi interpolation
8
5. Objective cross validation
Leave One Out Cross Validation (LOOCV): exclusion of one observation at time
![Page 18: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/18.jpg)
xi estimate error?
8
5. Objective cross validation
Leave One Out Cross Validation (LOOCV): exclusion of one observation at time
![Page 19: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/19.jpg)
residual approach
9
5. Objective cross validation
LOOCV
![Page 20: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/20.jpg)
residual approach
9
5. Objective cross validation
LOOCV
![Page 21: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/21.jpg)
Method MBE (K) MAE (K) RMSE (K)
IDW -2.71E-02 1.49E-01 2.05E-01
EWISD -8.90E-03 1.25E-01 1.93E-01
NN -1.38E-01 3.27E-01 4.23E-01
R-IDW -4.20E-04 1.02E-01 1.39E-01
R-EWISD -8.05E-04 8.45E-02 1.29E-01
R-NN -9.72E-02 2.63E-01 3.58E-01
RK -5.90E-06 9.80E-03 2.26E-02
10
5. Objective cross validation
LOOCV
![Page 22: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/22.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi
11
![Page 23: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/23.jpg)
xi
11
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
![Page 24: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/24.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi estimate error?
11
![Page 25: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/25.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi estimate error?
11
![Page 26: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/26.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi estimate error?
11
![Page 27: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/27.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi estimate error?
11
![Page 28: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/28.jpg)
6. Modified cross validation
Modified LOOCV: exclusion of subsets of observations of increasing radius
xi estimate error?
11
![Page 29: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/29.jpg)
6. Modified cross validation
Modified LOOCV
flight #M
method
MBE
RK
methodMAE
RK
methodRMSE
RK
MBEr
MBE
MAEr
MAE
RMSEr
RMSE
RK
RK RK
dimensionless radiusomni
radius
I
max distance of correlationomniI
12 dimensionless radius dimensionless radius dimensionless radius
![Page 30: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/30.jpg)
Is RK-predicted variance a good estimate of the interpolation error?
flight #M
6. Modified cross validation
2
21 1
ˆ1 1
ˆ
N Ni i
i
i i iN N
x xx
x
#M
#N
#A
RK estimate variance
13 dimensionless radius
dimensionless radiusomni
radius
I
max distance of correlationomniI
![Page 31: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/31.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
14
![Page 32: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/32.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
14
METTERE TUTTI I METODI IN SEQUENZA!!!!
![Page 33: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/33.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
14
![Page 34: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/34.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
14
![Page 35: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/35.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
14
![Page 36: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/36.jpg)
7. Conclusions
• The performances of 4 interpolation methods for the retrieval of fine-scale ABL
structures from airborne measurements were compared
• LOOCV:
o RK performs better than the other methods (IDW, EWISD, NN)
o the residual approach improves the performance of all methods (especially IDW
and EWISD)
• modified CV:
o RK performs better than the other methods when observations are clustered (i.e.
along a flight trajectory)
o RK variance overestimates the interpolation error for distances shorter than ½
correlation range
• The interpolated fields provide an ideal benchmark for comparison with high-
resolution numerical model output
14
![Page 37: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/37.jpg)
Thank you for your attention
14
www.gommoneclubverona.com The Adige Valley from Castel Beseno.
![Page 38: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/38.jpg)
• Laiti, L., D. Zardi, M. de Franceschi, G. Rampanelli. L. Giovannini (2014): Analysis of the diurnal development of a
lake-valley circulation in the Alps based on airborne and surface measurements. Under review in Atmos. Chem.
Phys., published in Atmos. Chem. Phys. Discuss., 13, 19121-71. http://dx.doi.org/10.5194/acpd-13-19121-2013
• Laiti, L., D. Zardi, M. de Franceschi, G. Rampanelli (2013): Atmospheric boundary layer structures associated with
the Ora del Garda wind in the Alps as revealed from airborne and surface measurements. Atmos. Res., 132-133,
473-489. http://dx.doi.org/10.1016/j.atmosres.2013.07.006
• Laiti, L., D. Zardi, M. de Franceschi, G. Rampanelli (2013): Residual kriging analysis of airborne measurements:
application to the mapping of atmospheric boundary-layer thermal structures in a mountain valley. Atmos. Sci.
Lett., 14, 79-85. http://dx.doi.org/10.1002/asl2.420
• Laiti, L. (2013): An investigation of the Ora del Garda wind by means of airborne and surface measurements. PhD
thesis, University of Trento. http://eprints-phd.biblio.unitn.it/1013/
• Cressie, N.A.C. (1993): Statistics for Spatial Data, revised edition. John Wiley & Sons, 928 pp.
• de Franceschi, M., G. Rampanelli, D. Sguerso, D. Zardi, P. Zatelli (2003): Development of a measurement
platform on a light airplane and analysis of airborne measurementsi n the atmospheric boundary layer. Ann.
Geophys., 46, 269-283. http://dx.doi.org/10.4401/ag-3401
• Egger, J. (1983): Pressure distributions in the Dischma Valley during the field experiment DISKUS. Contrib. Atmos.
Phys., 56, 163-176.
• Hennemuth, B. (1985): Temperature field and energy budget of a small Alpine valley. Contrib. Atmos. Phys., 58,
545-559.
• Weigel, A.P., M.W. Rotach (2004): Flow structure and turbulence characteristics of the daytime atmosphere in a
steep and narrow Alpine valley. Q. J. Roy. Meteorol. Soc., 130, 2605-2627.
References
![Page 39: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/39.jpg)
The target variable (i.e. θ residuals) must be normally distributed (random process)
Remarks about kriging - 1
δ (residuals of θ)
theoretical normal distribution
![Page 40: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/40.jpg)
To deal with the anisotropy of the target field:
1. the directional semivariograms were estimated to get the anisotropy scales
(semivariogram ranges, i.e. correlation ranges)
2. the spatial coordinates were rescaled by anisotropy ratios
3. the omnidirectional semivariogram was estimated and finally used in RK
horizontal semivariogram
vertical semivariogram
omnidirectional semivariogram
Ix = 2100 m Iz = 600 m
Remarks about kriging - 2
z
x
z
y
xx I
I
yy I
I
z z
2
1
1 1
2
N
i j i i
iN
h
h
x x h x x h
Iomni = 700 m
![Page 41: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/41.jpg)
Kriging also provides an estimate of the interpolation error, i.e. the kriging variance (or
kriging standard deviation)
(K)
Remarks about kriging - 3
2 0ˆ g i i giq x x x
![Page 42: Comparative assessment of methods to retrieve fine-scale ......Comparative assessment of methods to retrieve fine-scale ABL structures from airborne measurements L. Laiti 1, D. Zardi,](https://reader034.fdocuments.in/reader034/viewer/2022042806/5f696b1d9e025c6f037790a8/html5/thumbnails/42.jpg)
6. Modified LOOCV results
Modified LOOCV: exclusion of subsets of observations of increasing radius
flight #M
2
21 1
ˆ1 1
ˆ
N Ni i
i
i i iN N
x xx
x
1
%
i x
#M
#N
#A
#M
#N
#A
RK estimate variance
13 dimensionless radius dimensionless radius
dimensionless radiusomni
radius
I
max distance of correlationomniI