Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries...

200
MET info 22/2015 Meteorology Verification of Experimental and Operational Weather Prediction Models March to May 2015 Bjørg Jenny Kokkvoll Engdahl and Mariken Homleid With contributions from: Anne-Mette Olsen, Vibeke Wauters Thyness, and Magnus Ovhed Photo: Ingrid Våset

Transcript of Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries...

Page 1: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

MET info 22/2015Meteorology

Verification of Experimental and Operational Weather Prediction

Models March to May 2015

Bjørg Jenny Kokkvoll Engdahl and Mariken HomleidWith contributions from:

Anne-Mette Olsen, Vibeke Wauters Thyness, and Magnus Ovhed

Photo: Ingrid Våset

Page 2: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

Contents

1 Models 1

2 Post processed models 1

3 HARMONIE, AROME-Norway and AROME-MetCoOp 2

3.1 ALARO-0 physics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

3.2 AROME physics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

3.3 SURFEX as surface model . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

3.4 Data assimilation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

3.4.1 Surface analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

3.4.2 Upper air analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3

3.5 Boundaries and initialization of upper air fields . . . . . . . . . . . . . . . . . . . 4

4 Verification measures 4

4.1 Forecasts of continuous variables . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

4.2 Forecasts of categorical variables . . . . . . . . . . . . . . . . . . . . . . . . . . . 5

4.3 Observations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6

5 Norway 7

5.1 Comments to verification results . . . . . . . . . . . . . . . . . . . . . . . . . . . 7

5.2 Pressure and variables at pressure levels . . . . . . . . . . . . . . . . . . . . . . 10

5.3 Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15

5.4 Max Mean Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22

5.5 Wind gust . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26

5.6 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29

5.7 Post processed temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . 35

5.8 Daily precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

6 Eastern Norway 44

6.1 Comments to the verification results . . . . . . . . . . . . . . . . . . . . . . . . . 44

6.2 Pressure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 48

6.3 Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51

6.4 Wind gust . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61

6.5 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64

6.6 Post processed temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . 71

6.7 Daily precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 74

7 Western Norway 80

7.1 Comments to the verification results . . . . . . . . . . . . . . . . . . . . . . . . . 80

7.2 Pressure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 83

7.3 Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 86

7.4 Max Mean Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 93

Page 3: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7.5 Wind gust . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97

7.6 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100

7.7 Post processed temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . 107

7.8 Daily precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110

8 Northern Norway 116

8.1 Comments to the verification results . . . . . . . . . . . . . . . . . . . . . . . . . 116

8.2 Pressure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119

8.3 Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122

8.4 Max Mean Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 129

8.5 Wind gust . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133

8.6 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 136

8.7 Post processed temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . 143

8.8 Daily precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 146

9 Long term forecast 152

9.1 Comments to the verification results . . . . . . . . . . . . . . . . . . . . . . . . . 152

9.2 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 153

9.3 Wind Speed 10m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 155

9.4 12h Precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 159

9.5 24h Precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 165

10 Appendix 169

10.1 10m Wind speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 169

10.2 Temperature 2m . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 180

10.3 Daily precipitation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191

ii

Page 4: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

2 POST PROCESSED MODELS

1 Models

The following models are verified in this report. All except EC are or have been running at MET.

EC Global model (IFS) at the ECMWF. From 26 January 2010 reso-

lution T1279 or approximately 16× 16 km2 horizontally. Available

resolution for verification at MET is 0.125◦ latitude and longitude.

Number of vertical levels increased from L91 to L137 25 June

2013.

Hirlam12 (H12) Version 7.1, horizontal resolution defined by a 12 × 12 km2 grid

since 13 February 2008.

Hirlam8 (H8) Version 7.1, horizontal resolution defined by a 8×8 km2 grid since

13 February 2008.

Harmonie5.5 HARMONIE cycle 36h1.3 with ALARO physics run on a 5.5 ×5.5 km2 grid from 4 May 2011 to 15 January 2013.

Harmonie2.5 HARMONIE cycle 36h1.3 with AROME physics run on a 2.5 ×2.5 km2 grid from 4 May 2011 to 26 February 2013.

AROME-MetCoOp (AM25) HARMONIE cycle 38h1.1 with AROME physics run on a 2.5 ×2.5 km2 grid on same domain as AROME-Norway; experimental

since 9 December 2013.

Analysis and lead times of forecasts are denoted by e.g. 00+30 UTC which indicates forecast

generated at 00 UTC and valid 30 hours later.

2 Post processed models

Most of the raw model data are post processed before being published on Yr. The models AM25

and H8 are statisticly post processed to represent the 10m max mean wind speed. After post

processing, these models are called AM25_PP and H8_PP.

For 2m temperature, the raw data is first interpolated to a 500m grid and then Kalman filtered.

These model fields are called AM25.KF and H8.KF.

The precipitation data is post processed by using a neighbourhood method. Through the

method, a median value is obtained. This field, called AM25.median is used to determine the

precipitation symbol at Yr.

For long term forecast, an ensemble of 51 members run at ECMWF is used to obtain a proba-

bilistic forecast. These fields are called EC_UKAL_KONSENSUS and EC_UKAL_MEDIAN for

the consensus and median forecast, respectively. If the probablistic forecast is calibrated before

it is published on Yr, it is called EC_KAL_. . .

1

Page 5: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

3 HARMONIE, AROME-NORWAY AND AROME-METCOOP

The deterministic model just called ECMWF, is also shown in the long term forecast graphs.

3 HARMONIE, AROME-Norway and AROME-MetCoOp

Experimental HARMONIE models have been run at MET Norway since August 2008, leading

to AROME-Norway which on 1 October 2013 was introduced on yr.no, and AROME-MetCoOp

which is run in cooperation between Swedish Meteorological and Hydrological Institue and MET

Norway and replaced AROME-Norway on yr.no 27 May 2014. HARMONIE is the acronym for

HIRLAM’s meso-scale forecast system (Hirlam Aladin Regional/Meso-scale Operational NWP

In Europe). The HARMONIE system includes several configuration options. This section

presents some of the main components and setups that are or has been used at MET. More

documentation is available on http://www.cnrm.meteo.fr/gmapdoc/.

3.1 ALARO-0 physics

ALARO-0 has physical parameterizations targeted for grey scale resolutions ( 4-10 km). It is

a spin-off of the Météo-France physical parameterizations used in the globale ARPEGE, but

with a separate radiation scheme, 3MT micro-physical frame work, and the Toucans turbulence

scheme. Much of the development has been done by the RC LACE (Regional Cooperation for

Limited Area modeling in Central Europe) community.

3.2 AROME physics

AROME (Applications of Research to Operations at MEsoscale) is targeted for horizontal reso-

lution 2.5 km or finer. It uses physical parameterizations based on the French academia model

Meso-NH and the external surface model SURFEX. AROME has been operational at Météo-

France since 18 December 2008, with a horizontal resolution of 2.5 km.

3.3 SURFEX as surface model

SURFEX (Surface externalisée) is developed at Météo-France and academia for offline exper-

iments and introduced in NWP models to ensure consistent treatment of processes related to

surface. Météo-France is already using SURFEX for some of their configurations and is plan-

ning to use it for all their configurations. Surface modelling and assimilation benefits from the

possibility to run offline experiments. SURFEX is also used for offline applications in e.g. hy-

drology, vegetation monitoring and snow avalanche forecasts.

2

Page 6: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

3 HARMONIE, AROME-NORWAY AND AROME-METCOOP 3.4 Data assimilation

SURFEX includes routines to simulate the exchange of energy and water between the atmo-

sphere and 4 surface types (tiles); land, sea (ocean), lake (inland water) and town. The land or

nature tile can be divided further into 12 vegetation types (patches). ISBA (Interaction between

Soil Biosphere and Atmosphere) is used for modelling the land surface processes. There are

3 ISBA options; 2- and 3-layer force restore and a diffusive approach, where the first one is

used in HIRLAM. Towns may be treated by a separate TEB (Town Energy Balance) module.

Seas and lakes are also treated separately. The lake model, FLAKE (Freshwater LAKE), has

recently been introduced in SURFEX. A global ECOCLIMAP database which combines land

cover maps and satellite information gives information about surface properties on 1 km resolu-

tion. The orography is taken from gtopo30.

“SURFEX Scientific Documentation” and “User’s Guide” are available on http://www.cnrm.meteo.fr/surfex/

3.4 Data assimilation

NWP models are updated regularly using observations received in real-time from the global

observing system. With one exception the models run at MET are updated at 00, 06, 12 and 18

UTC. AROME-MetCoOp is updated each third hour; at 00, 03, 06, 09, 12, 15, 18 and 21 UTC.

3.4.1 Surface analysis

Surface analysis is performed by CANARI (Code d’Analyse Nécessaire à ARPEGE pour ses

Rejets et son Initialisation) (Taillefer, 2002). The analysis method is Optimal Interpolation and

only conventional synoptic observations are used. 2 meter temperature and relative humidity

observations are used to update the surface and soil temperature and moisture.

The snow analysis is also performed with CANARI in analogy with the HIRLAM snow analysis.

Snow depth observations are used to update Snow Water Equivalent. The snow fields are anal-

ysed only at 06 UTC as there are very few snow depth observations at 00, 12 and 18.

The Sea Surface Temperature is not analysed, but taken from the boundaries. ECMWF uses

the OSTIA (Operational Sea Surface Temperature and Sea Ice Analysis) product, including SST

from UK Met Office and SIC from MET. The surface temperature over sea ice is taken from the

boundary model and remains unchanged through the forecast.

3.4.2 Upper air analysis

AROME-MetCoOp runs three dimensional variational (3D VAR) data assimilation using con-

ventional observations from synop stations, ships, radiosondes and aircrafts. AMSU-A and

AMSU-B/MHS data from the polar orbiting NOAA and METOP satellites is also used.

3

Page 7: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields

3.5 Boundaries and initialization of upper air fields

Harmonie5.5 and Harmonie2.5 got their boundary values (3-hourly) from the ECMWF model

at approximately 16 km resolution. The upper air fields were initialized from ECMWF forecasts

each cycle. Harmonie5.5 had 60 vertical levels (ECMWF60 using the ECMWF definition). Har-

monie2.5 had also 60 vertical levels (HIRLAM60 using the HIRLAM definition).

AROME-Norway and AROME-MetCoOp get their boundary values (1-hourly) from the ECMWF

model at approximately 16 km resolution. They have currently 65 vertical levels. AROME-

Norway do no upper air assimilation, the upper air fields are initialized from ECMWF forecasts

each cycle. None of the HARMONIE configurations at MET have applied digital filter initializa-

tion (DFI).

4 Verification measures

All model forecasts in this report are verified against observations by interpolating (bilinear) the

grid based forecasts to the observational sites. As a consequence, it should be noted that it is

the models’ abilities to forecast the observations that is being quantifed and assessed. Thus,

there is no attempt in this report to verify area averaged precipitation for example.

Verification is carried out both for raw and categorized forecasts. In the following, let f1, ..., fn

denote the forecasts and o1, ..., on the corresponding observations.

4.1 Forecasts of continuous variables

The verification statistics applied to continuous variables are defined in the table below

4

Page 8: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

4 VERIFICATION MEASURES 4.2 Forecasts of categorical variables

Statistic Acronym Formula Range Optimal score

Mean Error ME 1n

∑ni=1(fi − oi) −∞ to∞ 0

Mean Absolute Error MAE 1n

∑ni=1 | fi − oi | 0 to∞ 0

Standard Deviation of Error SDE(

1n

∑ni=1(fi − oi −ME)2

)1/2

0 to∞ 0

Root Mean Square Error RMSE(

1n

∑ni=1(fi − oi)

2)1/2

0 to∞ 0

Correlation COR1n

∑ni=1(fi−f)(oi−o)

SD(f)SD(o) −1 to 1 1

In the formula for COR the following definitions are used

f =1

n

n∑i=1

fi, o =1

n

n∑i=1

oi

SD(f) =( 1

n

n∑i=1

(fi − f)2)1/2

, SD(o) =( 1

n

n∑i=1

(oi − o)2)1/2

for the means and standard deviations of the forecasts and observations.

4.2 Forecasts of categorical variables

All variables in this report are continuous in raw form, but it is possible to categorize them and

verify these. For example, wind speed above a given threshold could be of interest which would

result in two possible outcomes (yes and no). The verification is then completely summarized

by a contingency table as the one shown below

event observed

yes no

yes a bevent forecasted

no c d

Verification statistics for such forecasts are listed in the following table

5

Page 9: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

4 VERIFICATION MEASURES 4.3 Observations

Statistic Acronym Formula Range Optimal score

Hit rate HR aa+c 0 to 1 1

False alarm rate F bb+d 0 to 1 0

False alarm ratio FAR ba+b 0 to 1 0

Equitable threat score ETS a−ara+b+c−ar −1/3 to 1 1 (0 = no skill)

Hanssen-Kuipers skill score KSS HR - F −1 to 1 1 (0 = no skill)

In the formula for ETS ar = (a + b)(a + c)/n.

4.3 Observations

All observations come from Klimadatavarehuset at MET. Only synop stations are used, except

for precipitation where all availiable stations are used for better spatial coverage. The model

wind speed is verified against the mean wind FF observations. For post processed wind speed,

the maxium 10 min mean wind speed last hour, FX, is used.

6

Page 10: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY

5 Norway

5.1 Comments to verification results

Mean Sea Level Pressure:

Slight increase in bias for AM25, compared with the winter season, which still has the highest

bias amongst the models. ECMWF still the best model for MSLP, while AM25 has the second

lowest MAE.

Wind speed:

Mean wind speed:

More diurnal variations in the bias during spring, than in the winter. Not so much diurnal variation

for AM25. Negative bias for ECMWF. The Hirlam models have negative biases during daytime

and positive biases in the night. AM25 has a postive bias, but only of about 0.25ms−1. AM25

scores better than the rest of the models in ETS. AM25 also has considerably more events above

21ms−1 compared with the rest of the models, still too few compared with the observations.

Max mean wind speed:

The post processed version of AM25 is generally underestimating the max mean wind speed.

H8_PP has a smaller bias, but AM25 scores highest for ETS.

Wind gust:

The wind gust from AM25 is generally too low, while the wind gust from H8 is similarly too high.

The 925hPa wind is quite similar in both models. MAE is considerably lower for the wind gust

than the 925hPa wind. The wind gust scores better for all thresholds except the highest, were

the 925hPa wind is slightly better.

Temperature 2m:

All models have a cold bias during the spring of 2015. H12 has the smallest bias. ECMWF

and AM25 also have a cold trend, and end up at around -1◦C after 63h. For ECMWF this is

actually an improvement from the winter season. While for AM25 it decrease in score. SDE is

reduced for all models, compared with the winter season. MAE is also in general reduced, but

the reduction is largest for ECMWF. In total H12 is the model with the lowest MAE for the spring.

Post processed temperature:

Hardly any bias in temperature after post processing. MAE is a bit reduced, few differences

between H8.KF and AM25.KF.

Daily precipitation:

Positive biases for all models, except AM25.median. ECMWF has the highest bias, while AM25

has the smallest bias and the lowest MAE. HR is highest for ECMWF for thresholds up to

25mm/day. For thresholds above this, AM25 has the highest HR. AM25.median has the lowest

FAR up to 25mm/day, and the highest ETS for thresholds below 8mm/day. ECMWF has the

highest ETS between 8-25mm/day. Above 25mm/day AM25 has the highest score. This is seen

again in the multiple contingency table, where AM25.median has the highest number correct in

7

Page 11: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.1 Comments to verification results

the lowest category, ECMWF rules the middle categories, while AM25 wins in the >50mm/day

category.

8

Page 12: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 13: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.2 Pressure and variables at pressure levels

5.2 Pressure and variables at pressure levels

●●

●●

●●

●●

● ●

ME

[hP

a]

3 9 15 21 27 33 39 45 51 57 63−1.0

−0.5

0.0

0.5

1.0

1.5159 stations

Lead Time [h]

AM25H8ECMWFH12

●●

●●

●●

●● ●

SDE

[hP

a]

3 9 15 21 27 33 39 45 51 57 630

1

2

3

159 stations

Lead Time [h]

AM25H8ECMWFH12

● ●

● ●●

●● ●

●●

●●

MAE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0.0

0.5

1.0

1.5

2.0

2.5

159 stations

Lead Time [h]

AM25H8ECMWFH12

10

Page 14: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.2 Pressure and variables at pressure levels

0

●●

●●

●●●

●●

●●

●●

●●●

●●●●

●●

●●

●●

AM25 H8 ECMWF H12

−1.0

−0.5

0.0

0.5

1.0

1.5

ME

Lead time [h]: 00+3,+6,..,+48 159 stations

●●●●●●

●●●●●●●●

●●

●●

●●●

●●

●●

●●●●●●●●

●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

2.5

SDE

Lead time [h]: 00+3,+6,..,+48 159 stations

11

Page 15: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.2 Pressure and variables at pressure levels

1111

1

1

1

1

1

22

22

2

2

2

2

2

3333

3

3

3

3

3

4444

4

4

4

4

4

55

55

5

5

5

5

5

−30 −20 −10 0 10 20

800

600

400

200

12345

+0+12+24+36+48

ME AM25 00 UTC

11

111

1

1

1

1

1

2222

2

2

2

2

2

2

33

333

3

3

3

3

3

44

444

4

4

4

4

4

55

555

5

5

5

5

5

−30 −20 −10 0 10 20

800

600

400

200

12345

+0+12+24+36+48

ME Hirlam12 00 UTC

11

111

1

1

1

1

1

222

22

2

2

2

2

2

333

33

3

3

3

3

3

444

44

4

4

4

4

4

55555

5

5

5

5

5

−30 −20 −10 0 10 20

800

600

400

200

12345

+0+12+24+36+48

ME ECMWF 00 UTC

1111

1

1

1

1

1

2222

2

2

2

2

2

3333

3

3

3

3

3

44

44

4

4

4

4

4

55

55

5

5

5

5

5

0 5 10 15 20 25 30 35

800

600

400

200

12345

+0+12+24+36+48

SDE AM25 00 UTC

11

111

1

1

1

1

1

22

222

2

2

2

2

2

33

333

3

3

3

3

3

444

44

4

4

4

4

4

55

55

5

5

5

5

5

5

0 5 10 15 20 25 30 35

800

600

400

200

12345

+0+12+24+36+48

SDE Hirlam12 00 UTC

11

11

1

1

1

1

1

1

22

222

2

2

2

2

2

33

333

3

3

3

3

3

444

44

4

4

4

4

4

555

55

5

5

5

5

5

0 5 10 15 20 25 30 35

800

600

400

200

12345

+0+12+24+36+48

SDE ECMWF 00 UTC

Geopotential height at 3 Norwegian stations

11

11

1

1

1

1

1

22

22

2

2

2

2

2

33

33

3

3

3

3

3

44

44

4

4

4

4

4

55

55

5

5

5

5

5

−1.5 −0.5 0.0 0.5 1.0 1.5

800

600

400

200

12345

+0+12+24+36+48

ME AM25 00 UTC

11

111

1

1

1

1

1

22

22

2

2

2

2

2

2

333

33

3

3

3

3

3

44

44

4

4

4

4

4

4

55

55

5

5

5

5

5

5

−1.5 −0.5 0.0 0.5 1.0 1.5

800

600

400

200

12345

+0+12+24+36+48

ME Hirlam12 00 UTC

11

11

1

1

1

1

1

1

22

22

2

2

2

2

2

2

333

33

3

3

3

3

3

4444

4

4

4

4

4

4

55

55

5

5

5

5

5

5

−1.5 −0.5 0.0 0.5 1.0 1.5

800

600

400

200

12345

+0+12+24+36+48

ME ECMWF 00 UTC

11

11

1

1

1

1

1

22

22

2

2

2

2

2

333

3

3

3

3

3

3

44

44

4

4

4

4

4

55

55

5

5

5

5

5

0 1 2 3 4 5 6 7

800

600

400

200

12345

+0+12+24+36+48

SDE AM25 00 UTC

111

11

1

1

1

1

1

222

22

2

2

2

2

2

333

33

3

3

3

3

3

44

44

4

4

4

4

4

4

55

55

5

5

5

5

5

5

0 1 2 3 4 5 6 7

800

600

400

200

12345

+0+12+24+36+48

SDE Hirlam12 00 UTC

11

11

1

1

1

1

1

1

2222

2

2

2

2

2

2

3333

3

3

3

3

3

3

44

444

4

4

4

4

4

55

55

5

5

5

5

5

5

0 1 2 3 4 5 6 7

800

600

400

200

12345

+0+12+24+36+48

SDE ECMWF 00 UTC

Wind speed at 3 Norwegian stations

12

Page 16: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.2 Pressure and variables at pressure levels

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0.0

0.5

1.0

1.5

2.0

2.5

Mean Absolute Error124 Norwegian stations 00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0.0

0.5

1.0

1.5

2.0

2.5

Standard Deviation of Error

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−1.5

−1.0

−0.5

0.0

0.5

1.0

1.5

Mean Error

13

Page 17: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 18: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.3 Wind Speed 10m

5.3 Wind Speed 10m

●●

● ●

●●

●● ●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

225 stations

AM25ECMWFH8H12

●●

●●

●● ●

●●

●●

●● ● ●

●●

● ●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

3.0

3.5225 stations

AM25ECMWFH8H12

●●

● ● ●

● ●●

●● ●

●●

●● ●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

225 stations

AM25ECMWFH8H12

15

Page 19: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.3 Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

225 stations

●● ● ●

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

225 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

225 stations

16

Page 20: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.3 Wind Speed 10m

0

●●

●●

●●

●●

●●

●●

●●

●●●●●●

●●

● ●

●●

●●●

●●●

●●

AM25 ECMWF H8 H12

−6

−4

−2

0

2

ME

Lead time [h]: 00+3,+6,..,+48 225 stations

●●●

●●●

●●●●

●●

●●

●●

●●●●

●●

●●

●●

●●●

●●●●●●●

●●

●●●

●●●●●

●●

●●

●●

AM25 ECMWF H8 H12

1

2

3

4

5

6

SDE

Lead time [h]: 00+3,+6,..,+48 225 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

91207 26226 45 1 0 117479

41157 109523 6379 184 21 157264

295 6356 7553 1013 232 15449

12 133 527 450 227 1349

0 15 41 64 65 185

132671 142253 14545 1712 545 291726

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

82042 26082 218 12 1 108355

50563 112612 8368 588 189 172320

65 3512 5647 806 192 10222

1 43 301 284 123 752

0 4 11 22 40 77

132671 142253 14545 1712 545 291726

OBS

EC

MW

F

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

98631 40611 768 123 43 140176

34007 98787 8272 550 148 141764

33 2800 5279 808 201 9121

0 51 214 218 134 617

0 4 12 13 19 48

132671 142253 14545 1712 545 291726

OBS

H12

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

79360 25474 176 6 0 105016

53266 113341 8676 630 171 176084

44 3393 5409 774 221 9841

1 41 271 276 119 708

0 4 13 26 34 77

132671 142253 14545 1712 545 291726

Lead time [h]: 00+3,+6,..,+48 UTC 225 stations

17

Page 21: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−5

−4

−3

−2

−1

0

1

200+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

149 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−5

−4

−3

−2

−1

0

1

243 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−5

−4

−3

−2

−1

0

1

25 Norwegian mountainous stations

Mean Error

Page 22: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.3 Wind Speed 10m

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1.0

1.5

2.0

2.5

3.0

3.5

00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

149 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1.0

1.5

2.0

2.5

3.0

3.5

43 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1.0

1.5

2.0

2.5

3.0

3.5

5 Norwegian mountainous stations

Standard Deviation of Error

19

Page 23: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.3 Wind Speed 10m

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1

2

3

4

5

00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

149 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1

2

3

4

5

43 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

1

2

3

4

5

5 Norwegian mountainous stations

Mean Absolute Error

20

Page 24: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 25: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.4 Max Mean Wind Speed 10m

5.4 Max Mean Wind Speed 10m

●●

● ●

●●

● ●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.5

225 stations

AM25AM25_PPH8H8_PP

● ●●

●●

● ● ●

● ●

●● ● ● ● ●

●●

●● ●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

3.0

3.5225 stations

AM25AM25_PPH8H8_PP

● ●

● ●● ●

● ●●

●●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

225 stations

AM25AM25_PPH8H8_PP

22

Page 26: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.4 Max Mean Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

225 stations

●● ● ●

●● ●

● ●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

225 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

225 stations

23

Page 27: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.4 Max Mean Wind Speed 10m

0

●●

●●

●●

●●

●●

●●

●●

●●

●●

●●●●●●

●●

●●●

●●

●●

AM25 AM25_PP H8 H8_PP

−6

−4

−2

0

2

4

ME

Lead time [h]: 00+3,+6,..,+48 225 stations

●●●

●●●

●●●●

●●

●●

●●●

●●●●

●●●

●●●●

●●●

●●●●●●●

●●

●●●

●●●●●●●●

●●●

AM25 AM25_PP H8 H8_PP

1

2

3

4

5

6

SDE

Lead time [h]: 00+3,+6,..,+48 225 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

69705 41985 134 1 0 111825

20614 116540 10954 386 46 148540

85 4168 8362 1786 495 14896

0 74 361 500 374 1309

0 4 24 46 107 181

90404 162771 19835 2719 1022 276751

OBS

AM

25_P

P

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

66063 36337 92 1 0 102493

24193 119404 7958 213 19 151787

148 6854 10756 1488 334 19580

0 160 930 813 387 2290

0 16 99 204 282 601

90404 162771 19835 2719 1022 276751

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

62753 38748 366 24 3 101894

27631 121913 13206 841 338 163929

20 2088 6069 1515 406 10098

0 21 187 322 221 751

0 1 7 17 54 79

90404 162771 19835 2719 1022 276751

OBS

H8_

PP

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

58738 32957 222 7 0 91924

31556 121812 8242 479 185 162274

109 7790 9837 1109 313 19158

1 195 1392 849 283 2720

0 17 142 275 241 675

90404 162771 19835 2719 1022 276751

Lead time [h]: 00+3,+6,..,+48 UTC 225 stations

24

Page 28: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 29: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.5 Wind gust

5.5 Wind gust

●●

Lead time

ME

6 12 18 24 30 36 42 48 54 60 66

−1

0

1

2

201 stations

AM25_FGH8_FGAM25_925H8_925

●● ●

●●

Lead time

SDE

6 12 18 24 30 36 42 48 54 60 66

2.5

3.0

3.5

4.0

4.5

5.0

5.5

201 stations

AM25_FGH8_FGAM25_925H8_925

●●

●●

Lead time

MAE

6 12 18 24 30 36 42 48 54 60 661.5

2.0

2.5

3.0

3.5

4.0

201 stations

AM25_FGH8_FGAM25_925H8_925

26

Page 30: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.5 Wind gust

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Hit Rate

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

201 stations

● ●● ●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

False Alarm Ratio

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

201 stations

● ●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Equitable Threat Score

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

201 stations

27

Page 31: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 32: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.6 Temperature 2m

5.6 Temperature 2m

● ●

●●

●●

●●

● ● ●

● ●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63−1.5

−1.0

−0.5

0.0

0.5279 stations

Lead Time

AM25H8ECMWFH12

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.3

1.4

1.5

1.6

1.7

1.8

1.9279 stations

Lead Time

AM25H8ECMWFH12

●●

●●

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.1

1.2

1.3

1.4

1.5

1.6

279 stations

Lead Time

AM25H8ECMWFH12

29

Page 33: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.6 Temperature 2m

0

●●

●●

●●●

●●●●

●●

●●

●●●

●●●

●●

●●

●●

●●

●●●

●●

●●

●●●

●●

●●

AM25 H8 ECMWF H12

−2

−1

0

1

ME

Lead time [h]: 00+3,+6,..,+48 279 stations

●●●

●●

●●

●●●

●●

●●

●●●

●●

●●●●

●●

●●

●●

●●

●●●

●●

●●●●●

●●

●●●●●●●

●●

●●●●●●

●●●

●●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

2.5

3.0

SDE

Lead time [h]: 00+3,+6,..,+48 279 stations

30

Page 34: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−3

−2

−1

0

1

00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

153 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−3

−2

−1

0

1

43 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−3

−2

−1

0

1

40 Norwegian inland stations

Mean Error

Page 35: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.6 Temperature 2m

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

153 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

43 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

40 Norwegian inland stations

Standard Deviation of Error

32

Page 36: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.6 Temperature 2m

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

00+24,+30,+36,+42 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

153 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

43 Norwegian coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

40 Norwegian inland stations

Mean Absolute Error

33

Page 37: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 38: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.7 Post processed temperature 2m

5.7 Post processed temperature 2m

● ●

●●

● ●

●●

● ● ●

● ●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

279 stations

Lead Time

AM25AM25.KFH8H8.KF

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.3

1.4

1.5

1.6

1.7

1.8

1.9

279 stations

Lead Time

AM25AM25.KFH8H8.KF

●●

● ●

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.1

1.2

1.3

1.4

1.5

1.6

279 stations

Lead Time

AM25AM25.KFH8H8.KF

35

Page 39: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.7 Post processed temperature 2m

0

●●

●●

●●●

●●●●

●●

●●●

●●

●●●

●●●●

●●

●●

●●

●●

●●●

●●●

●●

●●

●●

●●●●●

●●

AM25 AM25.KF H8 H8.KF

−2

−1

0

1

2

3

ME

Lead time [h]: 00+3,+6,..,+48 279 stations

●●●

●●

●●●●●

●●

●●

●●●●

●●

●●●

●●●●

●●

●●●●●

●●

●●●

●●●●●

●●

●●

●●

●●

●●●

●●●

●●

●●●●

●●

●●

AM25 AM25.KF H8 H8.KF

1.0

1.5

2.0

2.5

3.0

SDE

Lead time [h]: 00+3,+6,..,+48 279 stations

36

Page 40: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 41: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

5.8 Daily precipitation

ME

[mm

]

30 54

−1.0

−0.5

0.0

0.5

1.0

1.5

531 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

SDE

[mm

]

30 54

3.5

4.0

4.5

5.0

5.5531 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

MAE

[mm

]

30 54

2.0

2.5

3.0

3.5

531 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

38

Page 42: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

●●

● ●

●●

HR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

531 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●●

●●

●●

FAR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

531 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●● ●

●●

●● ●

ETS

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

531 stationsLead time [h]: 00+30

Exceedance threshold [mm]

39

Page 43: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

0

●●

●●●●●●●

●●●●

●●

●●

●●

●●

●●

●●●

●●●

●●

●●●

●●

●●●●

●●

●●

●●●●●

●●●●

●●

●●●●

●●●●●●●

●●

●●

●●

●●

●●●●●

●●●●●

●●

●●●

●●●

●●

●●

●●

●●●

●●●

●●●

●●●

●●●

●●

●●

AM25 AM25.med ECMWF H8 H12

−10

−5

0

5

ME

Lead time [h]: 00+30,+54 531 stations

●●●●●●●●●●●●●●●●●●●●●●

●●

●●

●●

●●

●●

●●●●●●●●●●●●●●●

●●

●●●●●

●●

●●●

●●

●●

●●

●●

●●●●●●●●●●●●●●●●●

●●●●●

●●

●●●

●●●

●●

●●

●●

●●●●●

●●●●●●●●●●●●●●●●

●●

●●●●

●●

●●

●● ●●●●●●●●●●●●●●●●●●●

●●

●●

●●

●●

●●●

●●

●●

●●●●●●

AM25 AM25.med ECMWF H8 H12

0

5

10

15

SDE

Lead time [h]: 00+30,+54 531 stations

OBS

AM

25

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

10943 2948 76 4 0 13971

8160 20809 4116 81 2 33168

665 6121 10016 1158 9 17969

35 124 729 940 75 1903

2 2 8 47 84 143

19805 30004 14945 2230 170 67154

OBS

AM

25.m

ed

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

11777 3698 120 4 0 15599

7629 21880 5276 133 2 34920

369 4365 9134 1323 23 15214

28 61 411 740 74 1314

2 0 4 30 71 107

19805 30004 14945 2230 170 67154

OBS

EC

MW

F

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

7705 1204 17 2 0 8928

11457 21158 3102 53 2 35772

606 7562 10817 1027 11 20023

35 79 1007 1123 97 2341

2 1 2 25 60 90

19805 30004 14945 2230 170 67154

OBS

H8

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

5865 994 20 2 0 6881

12979 20989 4280 98 2 38348

937 7953 10281 1517 18 20706

23 66 361 587 79 1116

1 2 3 26 71 103

19805 30004 14945 2230 170 67154

Lead time [h]: 00+30,+54 531 stations

40

Page 44: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−4

−2

0

2

4

00+30 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

96 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−4

−2

0

2

4

15 coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−4

−2

0

2

4

26 stations more than 500 m above sea level

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

−4

−2

0

2

4

19 stations with daily mean precipitation > 4 mm

Mean Error

41

Page 45: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

2

4

6

8

10

00+30 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

96 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

2

4

6

8

10

15 coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

2

4

6

8

10

26 stations more than 500 m above sea level

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

2

4

6

8

10

19 stations with daily mean precipitation > 4 mm

Standard Deviation of Error

42

Page 46: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

5 NORWAY 5.8 Daily precipitation

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

6

700+30 UTC

ECMWF Hirlam8 Harmonie2.5 AROME_Norway AM25

96 Norwegian stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

6

715 coastal stations

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

6

726 stations more than 500 m above sea level

Mar12 Jun12 Sep12 Dec12 Mar13 Jun13 Sep13 Dec13 Mar14 Jun14 Sep14 Dec14 Mar15

0

1

2

3

4

5

6

719 stations with daily mean precipitation > 4 mm

Mean Absolute Error

43

Page 47: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 Eastern Norway

6.1 Comments to the verification results

Snow-day in South-East Norway March 26

The public forecast on Yr.no was misleading.

A warm front approached from the south, with warm moist air overlaying the established cold

air in the region.

The cold layer below 5000ft is well represented in the profiles from Gardermoen and Rygge,

with the warm air sliding on top. AROME-MetCoOp seems to be slightly warmer near the sur-

face than the Hirlam models.

The two temperature plots show values AROME-MetCoOp before and after post-processing

of 2m-temperature, compared to SYNOP observations in the area near Oslo. Before post-

processing the 2m-tempertature is 1-2 ◦C higher than the observations. The post-processing

raises the temperature by some 1-2◦C, and is thereby pulling the forecast further away from

what is observed.

Combined with a symbol algorithm that is based heavily on T2m, this produced a forecast of

some 20-40 mm rain, while in reality we saw 20-40 cm snow. This error in forecasted/post-

processed 2m-temperature lasted for 2-3 days prior to the event, and this short period is not

visible in the overall statistics for temperature. However, for the forecasts issued for this partic-

ular day, it was of great importance.

Page 48: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.1 Comments to the verification results

Figure 1: Figures from the March 26 case. Topleft: Forecasters analysis of the synoptic situation. Topright:

Vertical profile from Gardermoen. Bottom: Vertical profile from Rygge.

45

Page 49: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.1 Comments to the verification results

Figure 2: Figures from the March 26 case. Topleft: Forecasted values from AROME (raw) and observa-

tions. Topright: Forecasted values from AROME (post processed) and observations. Bottom: Forecast

from Yr.

46

Page 50: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 51: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.2 Pressure

6.2 Pressure

● ●

●●

● ●

●●

ME

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

1.5

47 stations

Lead Time [h]

AM25H8ECMWFH12

●● ●

●●

●● ● ●

● ●

SDE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0.5

1.0

1.5

2.0

2.5

3.0

3.5

47 stations

Lead Time [h]

AM25H8ECMWFH12

● ●●

● ●●

●●

●● ●

●●

● ●

MAE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0.5

1.0

1.5

2.0

2.5

47 stations

Lead Time [h]

AM25H8ECMWFH12

48

Page 52: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.2 Pressure

0

●●

●●

AM25 H8 ECMWF H12

−1.0

−0.5

0.0

0.5

1.0

1.5

ME

Lead time [h]: 00+3,+6,..,+48 47 stations

●●●

●●●

●●

●●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

SDE

Lead time [h]: 00+3,+6,..,+48 47 stations

49

Page 53: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 54: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

6.3 Wind Speed 10m

●●

●●

●●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

1.576 stations

AM25ECMWFH8H12

● ●● ●

●●

● ●

● ●●

● ●

● ●●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 631.0

1.5

2.0

2.5

3.0

76 stations

AM25ECMWFH8H12

●●

● ●

●●

●●

●●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.0

1.5

2.0

76 stations

AM25ECMWFH8H12

51

Page 55: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

76 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

76 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

76 stations

52

Page 56: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

0

● ●

●●

●●●●

●●●●

AM25 ECMWF H8 H12

−6

−4

−2

0

2

ME

Lead time [h]: 00+3,+6,..,+48 76 stations

●●

●●

●●

●●

●●

●●

●●

●●

AM25 ECMWF H8 H12

1

2

3

4

5

6

SDE

Lead time [h]: 00+3,+6,..,+48 76 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

40042 7788 10 1 0 47841

15840 30683 1019 32 0 47574

75 1262 1340 127 38 2842

0 19 34 30 33 116

0 2 1 6 4 13

55957 39754 2404 196 75 98386

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

35427 7832 89 7 0 43355

20530 31682 1600 147 75 54034

0 240 712 41 0 993

0 0 3 1 0 4

0 0 0 0 0 0

55957 39754 2404 196 75 98386

OBS

EC

MW

F

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

40834 12446 342 99 40 53761

15123 27135 1401 61 35 43755

0 173 660 36 0 869

0 0 1 0 0 1

0 0 0 0 0 0

55957 39754 2404 196 75 98386

OBS

H12

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

34093 7597 81 6 0 41777

21864 31956 1725 151 75 55771

0 201 596 38 0 835

0 0 2 1 0 3

0 0 0 0 0 0

55957 39754 2404 196 75 98386

Lead time [h]: 00+3,+6,..,+48 UTC 76 stations

53

Page 57: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 58: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

0.8

−0.6

0.4

1.8

−0.3

−0.5

0

−0.2

−0.1

−0.3

0.1

0

0.3

−0.2

−1.1

−0.7

−0.3

−1.3

−0.4

−0.6

−0.9

−0.7−0.2

1.8−0.5

0.3−0.50.3

0.3

−0.3

0.9

0.4

−0.7

−0.1

1

−0.4

0.3

0.2

0.5

1.5

1.9

−11.2

0.6

−2.6

0.1

0

−0.61.1

−0.41.3

0.11

0.2

0.2

0.6

0.1

−0.4

0.7

−0.2

−0.2

0.2

1.1

0.9

−0.1

0.4

−1.2

0.7

0

−2.5

0.8

1

0.22.8

0.4−0.7

0.8

0.60.3

−0.1

0.7

1.7

−0.9

0.4

−0.5

−0.9

1.7

−1 0.5

−1.1

1.7

1

−1.4−0.5

0.7

1.1

0.70.2

1.40.9

0.60.2

0.5

−0.1

0.3−0.2

−0.2

1.5

0.3

−3

−0.40.9

−0.9

−1

−1.3

0.2−1.2

−2.7

0−0.9

−0.1−0.3

−0.41.2

−0.7

−0.4

−0.1

0.3

−0.8

0

−1.5

−0.8

0.2

−1.1

−0.7

0.7 0.7

0.3

0.7

0−1.3

55

Page 59: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

●●

● ●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.5

1.0

76 stations

AM25AM25_PPH8H8_PP

● ●● ●

●●

● ●● ●

●●

● ●

●● ●

●●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 631.0

1.5

2.0

2.5

3.0

76 stations

AM25AM25_PPH8H8_PP

●●

● ●●

● ●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.0

1.5

2.0

2.576 stations

AM25AM25_PPH8H8_PP

56

Page 60: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.6

1.1

1.3

2

1.2

1.1

1.3

1

1.3

1.8

1.4

1.2

1.6

1.5

1.4

1.1

1.7

2.1

1

1.5

1.2

1.21.2

1.41.3

1.21.31.2

1

1.6

1.4

1.51.5

1.5

1.5

1.5

1.3

2.12.4

2.1

2.9

3.42.2

1.92.4

1.4

1.2

1.51.8

1.82.2

1.31.4

1.3

1.6

1.9

1.6

1.9

2.1

1.9

1.6

1.4

2.4

1

1.71.3

1.9

2

1.4

3.2

1.5

1.6

22.9

1.5 1.9

1.5

1.91.1

1.9

2

2

1.3

1.9

1.3

1.4

1.8

2.2 1.9

1.7

1.5

1.5

2.2

2.2

2.22.3

1.8 1.8

31.5

1.9

2.1

2.2 2.3

1.9

2.6

1.8

2.6

1.91.6

1.7

1.8

2.4

1.8 2

2.8

1.82.7

1.91.8

2.72.8

2.1

2.5

2

1.3

2

1.7

1.9

2.1

1.9

2.3

1.8

1.8 1.7

2

1.7

1.72.2

57

Page 61: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

76 stations

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

76 stations

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

76 stations

58

Page 62: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.3 Wind Speed 10m

0

●●

●●●●

AM25 AM25_PP H8 H8_PP

−6

−4

−2

0

2

4

ME

Lead time [h]: 00+3,+6,..,+48 76 stations

●●

●●

●●

●●

●●

●●

●●

●●

●●

AM25 AM25_PP H8 H8_PP

1

2

3

4

5

SDE

Lead time [h]: 00+3,+6,..,+48 76 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

31860 14131 37 1 0 46029

8243 35887 1939 75 0 46144

24 961 1600 209 71 2865

0 14 29 32 44 119

0 1 1 1 9 12

40127 50994 3606 318 124 95169

OBS

AM

25_P

P

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

29967 12141 19 1 0 42128

10112 37420 1552 60 0 49144

48 1402 1967 194 53 3664

0 30 65 58 58 211

0 1 3 5 13 22

40127 50994 3606 318 124 95169

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

28274 13155 167 17 0 41613

11853 37710 2646 209 122 52540

0 129 791 90 2 1012

0 0 2 2 0 4

0 0 0 0 0 0

40127 50994 3606 318 124 95169

OBS

H8_

PP

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

26249 10701 90 5 0 37045

13842 38593 1602 175 98 54310

36 1680 1781 83 24 3604

0 19 132 54 2 207

0 1 1 1 0 3

40127 50994 3606 318 124 95169

Lead time [h]: 00+3,+6,..,+48 UTC 76 stations

59

Page 63: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 64: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.4 Wind gust

6.4 Wind gust

● ●

● ●

Lead time

ME

6 12 18 24 30 36 42 48 54 60 66−2

−1

0

1

2

68 stations

AM25_FGH8_FGAM25_925H8_925

●●

●●

Lead time

SDE

6 12 18 24 30 36 42 48 54 60 662

3

4

5

668 stations

AM25_FGH8_FGAM25_925H8_925

● ●

● ●

●●

Lead time

MAE

6 12 18 24 30 36 42 48 54 60 66

1.5

2.0

2.5

3.0

3.5

4.0

4.568 stations

AM25_FGH8_FGAM25_925H8_925

61

Page 65: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.4 Wind gust

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Hit Rate

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

68 stations

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

False Alarm Ratio

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

68 stations

● ●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Equitable Threat Score

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

68 stations

62

Page 66: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 67: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

6.5 Temperature 2m

● ●

●●

● ●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.595 stations

Lead Time

AM25H8ECMWFH12

● ●

●●

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.4

1.6

1.8

2.0

2.2

95 stations

Lead Time

AM25H8ECMWFH12

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.4

1.6

1.8

2.0

95 stations

Lead Time

AM25H8ECMWFH12

64

Page 68: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

0

●●

●●

●●

●● ●

●●

●●

AM25 H8 ECMWF H12

−2.0

−1.5

−1.0

−0.5

0.0

0.5

1.0

ME

Lead time [h]: 00+3,+6,..,+48 95 stations

●●

●●

●●

●●●

●●

●●

●●

●●

●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

2.5

3.0

SDE

Lead time [h]: 00+3,+6,..,+48 95 stations

65

Page 69: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

−0.2

−0.8

−0.9

−0.7

−1.3

−0.8

−0.3

−0.9

−1

−1.4

−0.3

−1.3

0.1

−0.6

−0.2

−0.5

−0.3

0.1

−1

−0.3−0.4

−0.3

−1.3 −1.2−1.1

−1.7−0.7

−0.9

−0.5

−1.3−1−2.2

−0.9

−1.1−0.7

−0.8−0.2−1.3

−1

−1.4−1

−1.1

−0.9

−1.1

−0.6

−0.9

−0.4

−0.6

−1

−1.3

−0.9

−0.6

−1

−1

−0.8

−0.20.6

−0.9

−1.2

−0.7

−0.5−0.2

−0.9

−0.2−0.8

−1−1.5−1.2

−1.1

−1.6

−0.7

−1.8−0.8

−0.1

−0.2

−0.8

−1.2

−1.1

−0.5

−1.4−0.1

−0.8

−1.9

−0.5

−0.6

−1.1

−0.8−1.5

−0.6−1.2

−0.2

−1.4−0.5−0.6

−0.5

−1.2

−1.1

−0.3

−1.4−1.1

−0.7

−1

−0.8

−0.7

−0.3

−0.6

−0.7

0.2

0.7

−0.3

−1

−1.5

0.2

−0.2

0

−1.1−0.8

−0.4−0.40 −2.3

−1.50.2

0

−1.3

−0.4−0.4

0.5

0.4

−1.2

−0.7

−0.90.4

−1.2

−0.8

0.1−0.8

−0.5

−0.2

−0.4

−0.8

−0.30.5

0.7

−1.80.6

−1.1−0.1

−0.1

0.1−1.8

−1.2

−1.8−2

−0.2

−0.8

−0.2

−0.7

−1.2

−0.4

−1.1

−0.5

−1

0.5

−0.6−1.1

−1.1 −1.4

−0.6

−0.5

−0.9−0.2−0.8

−0.9

−1

66

Page 70: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24ME at observing sites forecast means 01.03.2015 − 31.05.2015

−0.4

−1.3

−0.9

−0.3

−0.7

−0.6

−0.3

−0.5

−0.5

−0.5

−0.7

−0.2

0

0.7

−0.3

0.2

−1.1

−0.7

−0.8

−0.2−0.4

−1

−0.5 0.5−0.3

0.6−1.2

−1.1

−1.2

0.1

−0.50.5−1.4

−0.4−0.4

−0.4−10.6

−1.5

0.2

−0.9

0.8

0.3

0.5

0.2

0.2

−0.8

−1.3−1.4

0

−0.4

−1.6−1.2

−1

1

−0.4−1.6

−0.6

−1.2

−0.8

−0.6−0.4

−0.6

−1.4−0.9

−0.20.5

−0.2

−1.2

−0.1

0.6

0−1.5

−1.20.2

−0.3

−0.6

−0.8

−0.7

−0.7−1.1

−0.4

−0.4

−1.1

−0.7

0.5

−1.9−1.6

−0.1−0.4

1

−0.60.4−0.8

−0.9

−0.8

−1

0.1

00.1

−0.3

−0.3

−0.6

−0.7

−0.3

0.2

−0.9

−0.7

−0.9

0

−0.1

−0.5−0.7

−1.9

−0.3

0.3

−0.8

−0.7−1.5

0.1−0.7−0.3 −1.6

−0.1−0.4

−1

−0.1

−0.2−0.8

0

0.5

−1.2

−0.9

−0.3−1.1

−1.1

−1

−0.90.1

0.3

−1.2

−0.7

−0.4

0−1.1

−1.1

−1.8−1.2

−0.1−0.5

−0.8

−1.1−1.6

−0.3

−1.8−1

−1.1

−0.3

−1.2

−0.6

0.1

−1.1

−0.5

−1

−1.5

−1

−0.4−0.7

−0.5 −0.1

−0.6

−0.4

−0.5−0.9−0.6

−1.1

−0.6

67

Page 71: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.2

1.1

1.4

1.8

1.8

1.9

1.7

1.1

1

1.1

1

1.3

1.6

1.2

1.8

1.3

1.3

1.1

1

1.21.3

1.4

1.7 1.51.5

1.51.3

1.5

1.61.51.41.71.5

1.51.4

1.31.41.6

1.7

1.31.2

1.6

1.6

1.2

1.61.2

1.7

1.11.1

1.4

1.3

1.11.3

1.2

1.7

2.41.3

1.4

1.6

1.61.21.8

1.7

1.21.4

1.41.71.5

1.6

2.3

1.9

1.31.3

1.1

0.8

1.5

1

1.6

1.4

0.91.6

1.5

1.4

1.5

1.3

1

1.11.1

1.5 1.1

1.4

1.31.31.31.3

1.2

1

1.1

1.21.2

0.8

0.8

1.1

1.8

1.1

1.1

1

1.2

1.71.1

1

1.3

2.2

1.2

1.5

1.31.3

1.41.21.5 1.4

2.11.4

1.4

1.3

1.11.6 1.6

2.2

1.4

2.4

1.3 1.3

1.4

1

1.71.6

1.3

1.1

1.2

0.9

1.21.2

1.1

1.91.4

11.4

2.11.31.9

1

2.11.4

1.7

1

1.3

1.3

1.2

1.1

1.3

1.1

1.4

1.8

1.31.2

1.4 1.5

1.3

1.3

1.51.51.5

1.2

1.3

68

Page 72: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.5 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.3

1.1

1.3

1.6

1.3

1.4

1.1

0.9

0.7

0.8

1

0.7

1.1

1.7

1.6

0.8

1.1

1.3

1.1

1.71.6

1.6

1.4 2.11.7

1.81.7

1.6

1.6

2.11.52.11.3

1.61.7

1.61.41.9

1.9

2.11.3

2.7

2.2

3

2.42.9

1.6

1.91.5

2.7

3.5

2.31.9

1.6

3.1

21.3

1.9

1.3

1.921.7

1.9

1.32.7

1.82.21.6

1.8

1.8

2

2.31.5

1.9

2.9

1.5

1.1

1.7

1.5

0.9

1.5

1.9

1.2

1.7

1.8

2.3

2.22.4

1.80.9

1.7

1.21.81.6

1.3

1.8

2.2

1.6

11.3

0.9

0.8

1.5

1.7

1.1

1.6

1.4

1

1.61.9

1.3

1.7

2.1

2.2

1.5

2.71.5

1.61.21.61.8

1.31.4

1.2

1.3

1.31.3

1.6

2.6

1.5

2.3

1.41.5

1.6

1.1

1.51.9

1.4

1.1

1.2

1

2.21.4

1.3

2.31.3

1.31.3

1.71.42.2

0.8

1.82.1

1.8

0.9

1.2

1.2

0.9

1.1

1.5

1.1

1.6

1.5

2.21.9

1.6 1.7

1.6

1.4

1.61.51.5

1.3

1.5

69

Page 73: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 74: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.6 Post processed temperature 2m

6.6 Post processed temperature 2m

● ●

●●

●●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.5

95 stations

Lead Time

AM25AM25.KFH8H8.KF

●●

●●

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.4

1.6

1.8

2.0

2.2

95 stations

Lead Time

AM25AM25.KFH8H8.KF

●●

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.4

1.6

1.8

2.0

95 stations

Lead Time

AM25AM25.KFH8H8.KF

71

Page 75: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.6 Post processed temperature 2m

0

●●

●●

●●

●●

●●

●●

●●●

●●

AM25 AM25.KF H8 H8.KF

−2

−1

0

1

2

ME

Lead time [h]: 00+3,+6,..,+48 95 stations

●●

●●

●●

●●

●●

AM25 AM25.KF H8 H8.KF

1.0

1.5

2.0

2.5

3.0

SDE

Lead time [h]: 00+3,+6,..,+48 95 stations

72

Page 76: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 77: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.7 Daily precipitation

6.7 Daily precipitation

ME

[mm

]

30 54

−0.5

0.0

0.5

1.0

1.5

222 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

● ●

SDE

[mm

]

30 54

2.5

3.0

3.5

4.0

4.5

222 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

MAE

[mm

]

30 54

1.5

2.0

2.5

3.0222 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

74

Page 78: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.7 Daily precipitation

●●

●●

● ●

HR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

222 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●●

● ●

FAR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

222 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●●

●●

● ●

ETS

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

222 stationsLead time [h]: 00+30

Exceedance threshold [mm]

75

Page 79: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.7 Daily precipitation

0

●●●●

●●

●●●●

●●

●●

●●●

●●

●●●

●●

●●

●●●

●●

●●●●

●●●●

●●●

●●

●●

●●●

●●●

●●

●●

AM25 AM25.med ECMWF H8 H12

−2

0

2

4

ME

Lead time [h]: 00+30,+54 222 stations

●●

●●

●●●●

●●

●●●

●●

●●●●

●●

●●●●●●

●●

●●●●●●

●●

●●●

●●

●●

●●●●●●●●

●●

●●

●●

●●

●●●●●●

●●

●●

●●

AM25 AM25.med ECMWF H8 H12

2

4

6

8

10

SDE

Lead time [h]: 00+30,+54 222 stations

OBS

AM

25

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

7055 1498 30 2 0 8585

3854 7677 1225 14 2 12772

272 1950 3093 166 0 5481

17 24 124 166 2 333

0 0 0 4 0 4

11198 11149 4472 352 4 27175

OBS

AM

25.m

ed

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

7585 1916 56 2 0 9559

3445 7755 1495 20 2 12717

149 1464 2827 174 0 4614

19 14 94 155 2 284

0 0 0 1 0 1

11198 11149 4472 352 4 27175

OBS

EC

MW

F

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

5071 678 8 2 0 5759

5843 8405 1164 15 2 15429

265 2031 3118 167 0 5581

19 35 182 168 2 406

0 0 0 0 0 0

11198 11149 4472 352 4 27175

OBS

H8

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

3889 596 9 2 0 4496

6929 7956 1376 20 2 16283

369 2571 3029 272 2 6243

11 26 58 58 0 153

0 0 0 0 0 0

11198 11149 4472 352 4 27175

Lead time [h]: 00+30,+54 222 stations

76

Page 80: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 81: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.7 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30ME at observing sites forecast means 01.03.2015 − 31.05.2015

1.4

1.1

0.30.1

0.3

−0.1 0.5

0.2

0.3

0.4

0.6

−0.1

0.31

0.3

0.90.7

0.70.50.4

0.4

0.8

0.7

1

0.6

0.5

0.6

0

1.2

0.6

1.2

0.5

0.5

1.3

0.4

0.8

0.3

1.21.9

0.40

0.5

1

0.50.6

0.7

1.6

0.3

−0.5

0.2

0.4

0.3

0.6

0.50.5

0.30.7

0.5

0.2

0.2

0.6

0.7

0.3

0.6

−0.2

−0.5

−0.9

−0.6

−2.2

−1.1

0.5

−1

−1.2

−0.1

−0.4

2.4

1.6

3.41

0.4−0.60.6

0.5

−1.3−0.3

−0.5

1.5

−2.1−0.5

0.3

2.5

4.5

−1.4

2.2−0.3

1.8 4.12.3

1.5

2.61.7

0

5.23.3

2

0.9

−0.2

0.6

0.5

1.6

0.8

1

1.5 1.2

1

0.5

1.1

0.3

0.7

78

Page 82: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

6 EASTERN NORWAY 6.7 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30SDE at observing sites forecast means 01.03.2015 − 31.05.2015

2.8

3

2.82.3

2

2.6 2.6

2.72.4

1.4

2.6

2.5

2.33.62.9

2.43.5

2.12.21.7

2.2

33.6

3.1

2.4

1.3

2.7

1.6

2.2

2.2

2.8

1.8

2.6

2.7

2

2.6

1.6

2.53.8

2.12.2

2.2

2.4

1.41.6

2

4.1

2.4

2.6

2.5

2.7

2.1

1.8

1.72.2

5.1 3.2

2.5

2.8

2.2

2.4

1.8

4.7

3.8

2.7

3.2

3.7

4

6.44.1

5.34.1

5.2

5.2

6.8

3.2

3.9

5.67

44.43.3 4.3

5.95

4.7

8.5

6.72.4

5.8

6.2

7.9

4.8

6.38.5

4.3 6.75.4

5.16.85.1

3.5

7.65.4

4.6

2.7

3.5

4.9

3.1

3.8

2.2

1.8

2.8 3

2.5

4.3

3.43.2

3.1

79

Page 83: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 Western Norway

7.1 Comments to the verification results

Wind speed 10 m:

For the period 1st of March 2015 to 31th of May 2015 Arome, Hirlam12 and Hirlam8 have a

small positive bias in wind speed during night time and a small negative bias in the afternoon.

ECMWF has a negative bias at both day time and night times. Arome scores best for wind

speeds below 20ms−1 and Hirlam 8 scores best for wind speeds above 20ms−1.

Max mean wind speed 10 m:

For Max Mean Wind Speed, both Arome and Hirlam8 have a negative bias. After postprocess-

ing both Arome and Hirlam8 have small negative biases. For max mean wind speed Arome

scores better for wind speeds below 15ms−1, while Arome and Hirlam are equal above 15ms−1.

Wind gust:

For wind gust Arome has a negative bias around 1ms−1, while Hirlam8 has a positive bias be-

tween 0.5 and 1 ms−1 . If we look at wind speed at 925 hPa (which is often used as an estimate

of wind gust), there are only minor differences in bias between the Arome and Hirlam8. Both

have a positive bias around 1ms−1 at midnight and a negative bias around 1ms−1 around noon.

Wind gust from Arome scores best for wind speeds below 15ms−1, while Hirlam8 scores better

for stronger wind gust. Wind gust from Arome and Hirlam8 score better than wind speed at 925

hPa for wind gust below 25ms−1, while wind speed at 925 hPa score better for wind gust above

25ms−1.

Temperature 2m:

For temperature Hirlam12, Hirlam8, Arome and ECMWF all have a negative bias. Both Arome

and ECMWF have an increasing negative bias with lead time. After post-processing both Arome

and Hirlam8 have almost no bias.

Precipitation:

For precipitation Arome, Hirlam8 and Hirlam12 have almost no bias, while ECMWF have a pos-

itive bias. Arome scores best for both light and heavy precipitation, while ECMWF scores better

for precipitation between 5 and 30 mm pr 24 hours.

Case VV: Fog over the North Sea:

On June 11-12, AROME has a large area with fog over the North Sea, while satellite images

show no fog.

Page 84: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.1 Comments to the verification results

Figure 3: Figures from the June 11 at 06 UTC. Left: Fog from AROME. Right: Satellite image.

81

Page 85: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 86: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.2 Pressure

7.2 Pressure

●●

●●

ME

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

1.554 stations

Lead Time [h]

AM25H8ECMWFH12

●●

●●

●●

●●

●●

●●

SDE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0

1

2

3

454 stations

Lead Time [h]

AM25H8ECMWFH12

● ●

● ●

●●

●● ●

●●

●●

MAE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0.0

0.5

1.0

1.5

2.0

2.5

54 stations

Lead Time [h]

AM25H8ECMWFH12

83

Page 87: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.2 Pressure

0

●●

●●

●●

●●

AM25 H8 ECMWF H12

−0.4

−0.2

0.0

0.2

0.4

0.6

0.8

ME

Lead time [h]: 00+3,+6,..,+48 54 stations

●●

●●●

●●

●●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

SDE

Lead time [h]: 00+3,+6,..,+48 54 stations

84

Page 88: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 89: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.3 Wind Speed 10m

7.3 Wind Speed 10m

●●

●●

●●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63−1.5

−1.0

−0.5

0.0

0.5

1.075 stations

AM25ECMWFH8H12

●●

● ●

●●

●● ●

●●

●● ● ● ● ●

● ●●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

3.0

3.575 stations

AM25ECMWFH8H12

● ●●

●● ● ●

●●

● ● ●● ●

● ●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.0

1.5

2.0

2.5

75 stations

AM25ECMWFH8H12

86

Page 90: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.3 Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

75 stations

●● ● ●

● ●●

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

75 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

75 stations

87

Page 91: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.3 Wind Speed 10m

0

●●

●●●

●●

●●

●●

AM25 ECMWF H8 H12

−4

−3

−2

−1

0

1

2

ME

Lead time [h]: 00+3,+6,..,+48 75 stations

●●

●●●

●●

●●●●

●●

AM25 ECMWF H8 H12

1.0

1.5

2.0

2.5

3.0

3.5

4.0

SDE

Lead time [h]: 00+3,+6,..,+48 75 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

29585 9966 21 0 0 39572

12602 37398 2468 51 1 52520

75 1746 2789 478 86 5174

4 19 157 219 112 511

0 1 7 23 28 59

42266 49130 5442 771 227 97836

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

27778 10142 106 5 1 38032

14470 37727 2792 146 14 55149

17 1250 2430 434 98 4229

1 10 112 178 84 385

0 1 2 8 30 41

42266 49130 5442 771 227 97836

OBS

EC

MW

F

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

33819 15289 282 22 3 49415

8440 32895 2836 162 18 44351

7 934 2259 470 105 3775

0 9 64 112 91 276

0 3 1 5 10 19

42266 49130 5442 771 227 97836

OBS

H12

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

27293 10264 82 0 0 37639

14963 37751 2961 174 17 55866

9 1106 2306 423 105 3949

1 9 91 164 81 346

0 0 2 10 24 36

42266 49130 5442 771 227 97836

Lead time [h]: 00+3,+6,..,+48 UTC 75 stations

88

Page 92: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 93: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

0.8

0.4

1.8

−0.3

−0.1

−0.3

0.1

0

0.3

−0.2

−1.1

−0.4

−0.3

−0.1

−0.7

−1.3

−0.4

−0.6

−0.9

−0.7−0.2

1.8−0.5

0.3−0.50.3

0.3

−0.3

0.9

0.4−0.7

−0.1

1

−0.4

0.3

0.20.5

1.5

1.9

−11.2

0.6

−2.6

0.1

0

−0.61.1

−0.41.3

0.11

0.2

0.2

0.6

0.1

−0.4

0.7

−0.2

−0.2

0.2

1.1

0.9

−0.1

0.4

−1.2

0.7

0

−2.5

0.8

1

0.22.8

0.4−0.7

0.8

0.60.3

−0.1

0.7

1.7

−0.90.4

−0.5

−0.9

1.7

−1

0.1

0.5

−1.1−0.4

−1.11.71−1.3

−1−0.4

−1.4−0.5

−0.6

−0.2

0.7

1.1

0.70.2

1.4 0.9

0.60.2

0.5

−0.1

0.3−0.2

−0.2

1.5

0.3

−3

−0.40.9

−0.9

−1

−1.3

0.2−1.2

−2.7

0−0.9

−0.1−0.3

−0.41.2

−0.7

−0.4

−0.1

0.3

−0.8

0

−1.5

−0.8

0.2

−1.1

−0.7

0.7 0.7

0.3

0.7

−0.1

0−1.3

0.3

0.4

0−1.1

−1

0.3

−0.22.1−0.3

0.2

1.6

2

2.1

1.1

−0.5

0

−0.4

0.5

1.5

1.5

0.8

1.5

0.4

0.6

90

Page 94: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.6

1.3

2

1.2

1.3

1.8

1.4

1.2

1.6

1.5

1.4

1

1.7

1.4

1.5 1.5

2.11

1.5

1.2

1.21.2

1.41.3

1.21.31.2

1

1.6

1.4

1.51.5

1.5

1.5

1.5

1.3

2.12.4

2.1

2.9

3.42.2

1.92.4

1.4

1.21.51.8

1.82.2

1.31.41.3

1.6

1.9

1.6

1.9

2.11.9

1.6

1.4

2.4

1

1.71.3

1.9

2

1.4

3.2

1.5

1.6

22.9

1.51.9

1.5

1.91.11.9

2

2

1.31.9

1.3

1.4

1.8

2.2

1.3

1.9

1.61.31.3

1.71.51.5

1.41.6

1.41.5

1.71.5

2.2

2.2

2.22.31.81.8

31.51.9

2.1

2.2 2.3

1.9

2.6

1.8

2.6

1.9 1.6

1.7

1.8

2.4

1.82

2.8

1.82.7

1.9 1.8

2.72.8

2.1

2.5

2

1.3

2

1.7

1.9

2.1

1.9

2.3

1.8

1.8 1.7

2

1.7

2.1

1.72.2

1.7

1.8

1.82.1

2.2

1.7

1.62.21.9

1.8

2.4

2.4

2

2

2.21.8

1.9

2.1

2.6

1.5

1.4

1.5

1.5

91

Page 95: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 96: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.4 Max Mean Wind Speed 10m

7.4 Max Mean Wind Speed 10m

● ●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63−2.0

−1.5

−1.0

−0.5

0.0

0.5

75 stations

AM25AM25_PPH8H8_PP

● ●●

●●

● ●●

●●

● ●● ●

●●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

3.0

3.5

75 stations

AM25AM25_PPH8H8_PP

●●

●●

●●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 631.0

1.5

2.0

2.5

75 stations

AM25AM25_PPH8H8_PP

93

Page 97: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.4 Max Mean Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

75 stations

●● ● ●

● ●

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

75 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

75 stations

94

Page 98: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.4 Max Mean Wind Speed 10m

0

●●

●●

AM25 AM25_PP H8 H8_PP

−3

−2

−1

0

1

2

3

ME

Lead time [h]: 00+3,+6,..,+48 75 stations

●●

●●

● ●

●●●

●●

●●

●●

AM25 AM25_PP H8 H8_PP

1.5

2.0

2.5

3.0

3.5

SDE

Lead time [h]: 00+3,+6,..,+48 75 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

22163 15821 65 0 0 38049

6164 39906 4481 147 11 50709

23 1087 2963 835 201 5109

0 12 100 214 189 515

0 0 1 19 43 63

28350 56826 7610 1215 444 94445

OBS

AM

25_P

P

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

21089 13534 52 0 0 34675

7222 41054 3029 67 5 51377

39 2206 4122 646 115 7128

0 32 379 396 174 981

0 0 28 106 150 284

28350 56826 7610 1215 444 94445

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

20772 14938 166 7 3 35886

7574 41131 4839 239 38 53821

4 753 2531 791 215 4294

0 4 73 173 150 400

0 0 1 5 38 44

28350 56826 7610 1215 444 94445

OBS

H8_

PP

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

19648 13157 113 2 0 32920

8676 40817 2864 102 24 52483

25 2787 3996 471 73 7352

1 61 584 490 184 1320

0 4 53 150 163 370

28350 56826 7610 1215 444 94445

Lead time [h]: 00+3,+6,..,+48 UTC 75 stations

95

Page 99: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 100: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.5 Wind gust

7.5 Wind gust

Lead time

ME

6 12 18 24 30 36 42 48 54 60 66

−1

0

1

267 stations

AM25_FGH8_FGAM25_925H8_925

●●

● ●

●●

Lead time

SDE

6 12 18 24 30 36 42 48 54 60 66

2.5

3.0

3.5

4.0

4.5

5.0

5.5

67 stations

AM25_FGH8_FGAM25_925H8_925

●●

● ●

●●

Lead time

MAE

6 12 18 24 30 36 42 48 54 60 66

2.0

2.5

3.0

3.5

4.0

67 stations

AM25_FGH8_FGAM25_925H8_925

97

Page 101: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.5 Wind gust

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Hit Rate

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

● ●● ● ● ●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

False Alarm Ratio

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Equitable Threat Score

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

98

Page 102: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 103: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

7.6 Temperature 2m

● ●

● ●●

●●

● ●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.595 stations

Lead Time

AM25H8ECMWFH12

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.3

1.4

1.5

1.6

1.7

95 stations

Lead Time

AM25H8ECMWFH12

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 631.0

1.1

1.2

1.3

1.4

1.5

1.6

1.795 stations

Lead Time

AM25H8ECMWFH12

100

Page 104: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

0

●●

●●●

●●

●●

●●

●●

●●

●●

AM25 H8 ECMWF H12

−2

−1

0

1

ME

Lead time [h]: 00+3,+6,..,+48 95 stations

●●●

●●●

●●

●●●●

●●

●●

●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

2.5

SDE

Lead time [h]: 00+3,+6,..,+48 95 stations

101

Page 105: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

−0.2

−0.9

−0.7

−0.9

−1

−1.4

−0.3

−1.3

0.1

−0.6

−0.3

−0.5

−0.3

−0.4

−0.3

0.1

−1

−0.3−0.4

−0.3

−1.3 −1.2−1.1

−1.7−0.7

−0.9

−0.5

−1.3−1−2.2

−0.9

−1.1−0.7

−0.8−0.2−1.3

−1

−1.4−1

−1.1

−0.9

−1.1

−0.6−0.9

−0.4

−0.6−1

−1.3

−0.9

−0.6−1

−1

−0.8

−0.20.6

−0.9

−1.2

−0.7−0.5−0.2

−0.9

−0.2−0.8

−1−1.5−1.2

−1.1

−1.6

−0.7

−1.8−0.8

−0.1

−0.2

−0.8

−1.2

−1.1

−0.5

−1.4−0.1

−0.8

−1.9

−0.5

−0.6

−1.1

−0.8−1.5

−0.6−1.2

−0.2

−1.4−0.5−0.6−0.5

−1.2

−1.1

−0.3

−1.4−1.1

−0.7

−1

−0.8

−0.7

−0.3

−0.1

−0.6

0−0.2

−0.6

−0.70.2

0.7

0

−0.8−0.5

−0.3

−0.2−1

−0.3

−0.8−1.5

0.2

−0.2

0

−1.1−0.8

−0.4−0.40 −2.3

−1.50.2

−0.2

0

−0.2

−1.3−0.9

−0.4−0.4

0.5

0.4

−1.2

−0.7

−0.9 0.4

−1.2

−0.8

0.1−0.8

−0.5

−0.2

−0.4

−0.8

−0.30.5

0.7

−1.80.6

−1.1−0.1

−0.1

0.1−1.8

−1.2

−1.8−2

−0.2

−0.8

−0.2

−0.7

−1.2

−0.4

−1.1

−0.5

−1

0.5

−0.6−1.1

−1.1−1.4

−0.6

−0.5

−0.3

−0.9−0.2−0.8

−0.9

−1

−0.8

−0.7

−0.6−1

−1.2

−0.4

−0.3−1.2−0.6

−0.6

−1.3

−1

−0.9

−0.7

−0.7

−0.9

−0.9

−0.7

−0.8

−0.2

−0.7

−0.7

−1

−1.3

−0.4

102

Page 106: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24ME at observing sites forecast means 01.03.2015 − 31.05.2015

−0.4

−0.9

−0.3

−0.5

−0.5

−0.5

−0.7

−0.2

0

0.7

0.1

0.2

−0.1

−0.7 −0.5

−1.1−0.7

−0.8

−0.2−0.4

−1

−0.5 0.5−0.3

0.6−1.2

−1.1

−1.20.1

−0.50.5−1.4

−0.4−0.4

−0.4−10.6

−1.5

0.2−0.9

0.8

0.3

0.5

0.2

0.2

−0.8

−1.3−1.4

0

−0.4

−1.6−1.2

−1

1

−0.4−1.6

−0.6

−1.2

−0.8−0.6−0.4

−0.6−1.4−0.9

−0.20.5−0.2

−1.2

−0.1

0.6

0−1.5

−1.20.2

−0.3

−0.6

−0.8

−0.7

−0.7−1.1

−0.4

−0.4

−1.1

−0.7

0.5

−1.9−1.6

−0.1−0.4

1

−0.60.4−0.8−0.9

−0.8

−1

0.1

00.1

−0.3

−0.3

−0.6

−0.7

−0.3

−0.3

0.2

−0.3−0.6−0.9

−0.7−0.9

0

−0.6

−0.3−0.1

−0.1

−0.5−0.7

−0.6

−0.4 −1.9

−0.3

0.3

−0.8

−0.7−1.5

0.1−0.7−0.3 −1.6

−0.1−0.4

−0.4

−1

−0.3

−0.1−0.4

−0.2−0.8 0

0.5

−1.2

−0.9

−0.3 −1.1

−1.1

−1

−0.90.1

0.3

−1.2

−0.7

−0.4

0−1.1

−1.1

−1.8−1.2

−0.1−0.5

−0.8−1.1−1.6

−0.3

−1.8−1

−1.1

−0.3

−1.2−0.6

0.1

−1.1

−0.5

−1

−1.5

−1

−0.4−0.7

−0.5 −0.1

−0.6

−0.4

−0.8

−0.5−0.9−0.6

−1.1

−0.6

−0.5

0.1

0−0.2

−0.2

−0.3

−0.5−0.3

−0.6

−0.7

−0.4

0

−0.7

−1.3−0.8

−0.2

−0.2

−0.2

−0.3

0

−0.2

−0.3

−0.6

−0.5

−0.1

103

Page 107: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.2

1.4

1.8

1.1

1

1.1

1

1.3

1.6

1.2

1.4

1.3

0.9

1.3 1.2

1.3

1.11

1.21.3

1.4

1.7 1.51.5

1.51.3

1.5

1.61.51.41.71.5

1.51.4

1.31.41.6

1.7

1.31.2

1.6

1.6

1.2

1.61.2

1.7

1.11.1

1.4

1.3

1.11.3

1.2

1.7

2.41.3

1.4

1.6

1.61.21.8

1.71.21.4

1.41.71.5

1.6

2.31.9

1.31.3

1.10.8

1.5

1

1.6

1.4

0.91.6

1.5

1.4

1.5

1.3

1

1.11.1

1.51.1

1.4

1.31.31.31.3

1.2

1

1.11.21.2

0.8

0.8

1.1

1.8

1.1

0.8

1.1

0.90.91

11.2

1.7

0.8

0.80.81.1

11

0.81.2 1.3

2.21.2

1.5

1.31.31.41.21.5 1.4

2.11.4

1.2

1.4

1

1.31

1.1 1.6 1.6

2.2

1.4

2.4

1.3 1.3

1.4

1

1.7 1.6

1.3

1.1

1.2

0.9

1.21.2

1.1

1.91.4

1 1.42.11.31.9

1

2.11.4

1.7

1

1.31.3

1.2

1.1

1.3

1.1

1.4

1.8

1.31.2

1.4 1.5

1.3

1.3

1.2

1.51.51.51.2

1.3

1.3

1.3

11

1

0.9

11.11.1

1.1

1.4

1.3

1.2

1.41

0.81.3

1.2

1.2

0.7

1.2

1.2

1

1.3

1.1

104

Page 108: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.3

1.3

1.6

0.9

0.7

0.8

1

0.7

1.1

1.7

1.3

0.8

0.6

1.21.2

1.1

1.31.1

1.71.6

1.6

1.4 2.11.7

1.81.7

1.6

1.62.11.52.11.3

1.61.7

1.61.41.9

1.9

2.11.3

2.7

2.2

3

2.42.9

1.6

1.91.5

2.7

3.5

2.31.9

1.6

3.1

21.3

1.9

1.3

1.921.7

1.91.32.7

1.82.21.6

1.8

1.8

2

2.31.5

1.92.9

1.5

1.1

1.7

1.5

0.91.5

1.9

1.2

1.7

1.8

2.3

2.22.4

1.8 0.9

1.7

1.21.81.61.3

1.8

2.2

1.611.3

0.9

0.8

1.5

1.7

1.1

0.8

1.6

1.11.21.4

1.41

1.6

0.8

1.20.81.9

1.21.3

0.9

1.11.7

2.1

2.2

1.5

2.71.5

1.61.21.6 1.8

1.31.4

0.9

1.2

0.8

1.30.9

1.31.3 1.6

2.6

1.5

2.3

1.4 1.5

1.6

1.1

1.5 1.9

1.4

1.1

1.2

1

2.21.4

1.3

2.31.3

1.3 1.3

1.71.42.2

0.8

1.82.1

1.8

0.9

1.2

1.2

0.9

1.1

1.5

1.1

1.6

1.5

2.21.9

1.6 1.7

1.6

1.4

1.3

1.61.51.5

1.3

1.5

1.7

1.6

1.41

0.9

1.1

1.31

1.2

1.4

1.5

1.7

2.1

1.7

1.1

11.8

0.8

0.9

0.9

0.9

0.8

0.8

0.8

0.8

105

Page 109: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 110: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.7 Post processed temperature 2m

7.7 Post processed temperature 2m

●●

● ●●

●●

● ●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

95 stations

Lead Time

AM25AM25.KFH8H8.KF

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.3

1.4

1.5

1.6

1.7

1.895 stations

Lead Time

AM25AM25.KFH8H8.KF

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.0

1.1

1.2

1.3

1.4

95 stations

Lead Time

AM25AM25.KFH8H8.KF

107

Page 111: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.7 Post processed temperature 2m

0

●●

●●

●●

●●

●●

●●

●●

AM25 AM25.KF H8 H8.KF

−2.0

−1.5

−1.0

−0.5

0.0

0.5

1.0

ME

Lead time [h]: 00+3,+6,..,+48 95 stations

●●●

●●●

●●

●●

●●

●●

●●

●●

AM25 AM25.KF H8 H8.KF

1.0

1.5

2.0

2.5

SDE

Lead time [h]: 00+3,+6,..,+48 95 stations

108

Page 112: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 113: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.8 Daily precipitation

7.8 Daily precipitation

ME

[mm

]

30 54

−1.5

−1.0

−0.5

0.0

0.5

1.0

1.5

206 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

SDE

[mm

]

30 54

4.5

5.0

5.5

6.0

6.5

206 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

MAE

[mm

]

30 54

3.0

3.5

4.0

4.5

206 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

110

Page 114: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.8 Daily precipitation

● ●

●●

●●

● ●

HR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

206 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●● ●

● ● ●

● ●

FAR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

206 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●●

● ● ●

● ●

● ●

ETS

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

206 stationsLead time [h]: 00+30

Exceedance threshold [mm]

111

Page 115: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.8 Daily precipitation

0

●●

●●

●●

●●

●●

●●

●●

●●

●●●

●●●●

●●●●

●●

●●●

●●

AM25 AM25.med ECMWF H8 H12

−10

−5

0

5

ME

Lead time [h]: 00+30,+54 206 stations

●●●●

●●●●

●●●●●●

●●●●

●●

●●

●●●●●● ●●●

●●

●●

●●●●●●

●●

●●●●●●●●●

●●

●●

●●

●●●●●●●

AM25 AM25.med ECMWF H8 H12

5

10

15

SDE

Lead time [h]: 00+30,+54 206 stations

OBS

AM

25

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

2539 967 30 2 0 3538

2552 8047 2120 61 0 12780

279 2815 5099 827 8 9028

14 88 461 672 72 1307

2 2 8 42 84 138

5386 11919 7718 1604 164 26791

OBS

AM

25.m

ed

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

2745 1200 46 2 0 3993

2491 8797 2845 103 0 14236

139 1883 4604 980 23 7629

9 39 219 490 70 827

2 0 4 29 71 106

5386 11919 7718 1604 164 26791

OBS

EC

MW

F

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

1715 309 5 0 0 2029

3441 7829 1366 28 0 12664

215 3752 5765 760 11 10503

13 28 580 791 93 1505

2 1 2 25 60 90

5386 11919 7718 1604 164 26791

OBS

H8

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

1457 268 5 0 0 1730

3512 7938 2058 71 0 13579

405 3683 5415 1047 16 10566

11 28 237 460 77 813

1 2 3 26 71 103

5386 11919 7718 1604 164 26791

Lead time [h]: 00+30,+54 206 stations

112

Page 116: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 117: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.8 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30ME at observing sites forecast means 01.03.2015 − 31.05.2015

1.4

1.1

0.30.1

0.3

−0.1 0.5

0.20.3

0.4

0.6

−0.1

0.310.3

0.90.7

0.70.50.4

0.4

0.80.7

1

0.6

0.5

0.6

0

1.2

0.6

1.2

0.5

0.5

1.3

0.4

0.8

0.3

1.21.9

0.40

0.5

1

0.50.6

0.7

1.6

0.3

−0.50.2

0.4

0.3

0.6

0.50.5

0.30.7

0.5

0.2

0.2

0.6

0.7

0.3

0.6

−0.2

−0.5

−0.9

−0.6

−0.3−0.7

−2.2−1.1

0.5

−0.2

−1

−1.2

−0.1

−0.4

2.4

1.6

3.41

0.4−0.60.60.5

−1.3−0.3

−0.2

−0.5

1.5

−2.1−0.5

0.3

2.5

4.5

−1.4

2.2−0.3

1.8 4.12.3

1.52.61.7

0

5.23.3

2

0.9

−0.2

0.6

0.5

1.6

0.8

1

1.5 1.2

1

0.5

1.10.3

0.7

0.5

0.7

0.3

0.80.5

0.3

0.1

0.2

1.1

0.6

114

Page 118: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

7 WESTERN NORWAY 7.8 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30SDE at observing sites forecast means 01.03.2015 − 31.05.2015

2.8

3

2.82.3

2

2.6 2.6

2.72.4

1.4

2.6

2.52.33.62.9

2.43.5

2.12.21.7

2.2

33.6

3.1

2.41.3

2.7

1.62.2

2.2

2.8

1.8

2.6

2.7

2

2.6

1.6

2.53.8

2.12.2

2.2

2.4

1.41.6

2

4.1

2.4

2.62.5

2.7

2.1

1.8

1.72.2

5.13.2

2.5

2.82.2

2.4

1.8

4.73.8

2.7

3.23.7

4

33.4

6.44.1

5.3

2.74.1

5.2

5.2

6.83.2

3.9

5.6744.43.3 4.3

5.95

2.9

4.7

8.56.7 2.4

5.8

6.2

7.9

4.8

6.3 8.5

4.3 6.75.4

5.16.85.1

3.5

7.65.4

4.6

2.7

3.5

4.9

3.1

3.8

2.2

1.8

2.8 3

2.5

4.3

3.43.2

3.1

3.1

3.4

2.72.8 2.9

3.9

4

2.7

3.5

3.4

115

Page 119: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 Northern Norway

8.1 Comments to the verification results

Case VNN: Complex topography, Arome 2.5km and preciptiation distribution

Episode with heavy precipitation in Vest-Finnmark May 23-24 2015

Synoptic situation: Slow moving system with semi-stationary occlusion front.

Feature: Heavy precipitation, 9 observations with 20-45mm/24h. Several "seasonal" records.

Model AROME 18Z 15.05.24

Max values: 105mm/24h (raw) 70mm/24h (pp-max) 55mm/24h (pp-median)

Max values lowland (<200m): 55mm/24h (estimated with topography mask.)

Comparing model with observations (mainly in lowland) shows that the model overall underpre-

dicted the amounts. However, the model have much more precipitation at higher elevations,

where we have no observations.

It is important to compare the precipitation fields with elevation masks in complex terrain, it is

otherwise easy to overpredict the amounts in lower, habitated areas. Current postprossessing

that smooth precipitation fields (pp-median, pp-max) may sometimes give a better estimates

compared to observations. Unfortunately there are a lot a variations between cases, due to to-

pography and precipitation distribution, so it is hard to tell if one of the precip-fields is generally

better than the others. Comparing them all, including elevation mask and/or habitated areas is

a common practise among experienced forecasters.

Page 120: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.1 Comments to the verification results

Figure 4: Figures from the heavy precipitation event May 23-24. Topleft: Satellite image and forecasters

analysis showing the synoptic situation. Topright: Accumulated 24h-precipitation field from AROME. Bot-

tomleft: Max values lowland estimated with topography mask. Bottomright: Scatterplot of observed and

forecasted 24h-precipitation.

117

Page 121: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 122: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.2 Pressure

8.2 Pressure

● ●

● ●

ME

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

50 stations

Lead Time [h]

AM25H8ECMWFH12

●●

●● ●

●●

●● ●

●●

SDE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0

1

2

3

450 stations

Lead Time [h]

AM25H8ECMWFH12

●●

● ●●

●●

●●

●●

MAE

[hP

a]

3 9 15 21 27 33 39 45 51 57 63

0.0

0.5

1.0

1.5

2.0

2.5

50 stations

Lead Time [h]

AM25H8ECMWFH12

119

Page 123: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.2 Pressure

0

AM25 H8 ECMWF H12

−0.5

0.0

0.5

ME

Lead time [h]: 00+3,+6,..,+48 50 stations

●●●

●●

●●●

●●●●

●●

AM25 H8 ECMWF H12

0.8

0.9

1.0

1.1

1.2

1.3

1.4

SDE

Lead time [h]: 00+3,+6,..,+48 50 stations

120

Page 124: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 125: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.3 Wind Speed 10m

8.3 Wind Speed 10m

●●

●● ●

●●

● ● ●

● ●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

1.0

74 stations

AM25ECMWFH8H12

●● ●

●●

● ●●

●●

● ●

●●

●●

●●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

2.0

2.5

3.0

3.5

74 stations

AM25ECMWFH8H12

● ●● ●

●●

●● ●

● ●

● ●

● ●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

74 stations

AM25ECMWFH8H12

122

Page 126: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.3 Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

74 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

74 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25ECMWFH8H12

74 stations

123

Page 127: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.3 Wind Speed 10m

0

●●

AM25 ECMWF H8 H12

−4

−2

0

2

ME

Lead time [h]: 00+3,+6,..,+48 74 stations

●●●

●●

●●

●●

●●

●●

AM25 ECMWF H8 H12

1

2

3

4

5

SDE

Lead time [h]: 00+3,+6,..,+48 74 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

21580 8472 14 0 0 30066

12715 41442 2892 101 20 57170

145 3348 3424 408 108 7433

8 95 336 201 82 722

0 12 33 35 33 113

34448 53369 6699 745 243 95504

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

18837 8108 23 0 0 26968

15563 43203 3976 295 100 63137

48 2022 2505 331 94 5000

0 33 186 105 39 363

0 3 9 14 10 36

34448 53369 6699 745 243 95504

OBS

EC

MW

F

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

23978 12876 144 2 0 37000

10444 38757 4035 327 95 53658

26 1693 2360 302 96 4477

0 42 149 106 43 340

0 1 11 8 9 29

34448 53369 6699 745 243 95504

OBS

H12

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

17974 7613 13 0 0 25600

16439 43634 3990 305 79 64447

35 2086 2507 313 116 5057

0 32 178 111 38 359

0 4 11 16 10 41

34448 53369 6699 745 243 95504

Lead time [h]: 00+3,+6,..,+48 UTC 74 stations

124

Page 128: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 129: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

1

0.4

0.4

0.4

−0.1

0.4

1.3

1.1

1.6

0.1

−0.4

−0.3

0.7

1.3

0.8

−0.6

1.2

−0.4

0.20.4

−0.2

−0.5

0.4

1.8

−0.2

−0.4

−0.3

−0.5

0

−0.2

−0.2

0.8

−0.2

−0.7

−0.1

−0.3

0.1

−0.2 −0.7

2.1

0.70.8

−0.3

−0.7

0.1

−0.5

0.2

0.1

0.4

−0.4

−1.7

−1.1

−0.1

−0.2

−2.1

0.9

0

0.9

0.8 0.4

−1

1.9

0

0.4

0.3

−0.2

0.6

0.2

−0.3

−0.1

1.8

1−1.5

1.6

0.1

−0.50.6

−1.3

−0.9

−0.8

−10.9

−1.3−0.4

−0.6

−0.9

−0.7−0.2

1.8−0.5

0.3−0.50.3

0.3

−0.3

0.9

0.4−0.7

−0.1

1

−0.4

0.3

0.20.5

1.5

1.9

−11.2

0.6−2.6

0.1

0−0.61.1

−0.41.3

0.110.2

0.2

0.6

0.1

−0.4

0.7−0.2

−0.2

0.2

1.1

0.9

−0.10.4

−1.2

0.7

0

−2.5

0.8

1

0.22.8

0.4−0.7

0.8

0.60.3−0.1

0.7

1.7

−0.90.4

−0.5

−0.9

1.7

0.5

1.71

0.7

1.1

0.70.2

1.40.9

0.60.2

0.5

0.3 −0.2

−0.2

1.5

0.3

−0.4 0.9

−0.9

−1

−1.3

0.2−1.2

−2.7

0−0.9

−0.1 −0.3

−0.41.2

−0.7

−0.4

−0.1

0.3

−0.8

0

−1.5

−0.8

0.2

−1.1

−0.7

0.7 0.7

0.3

0.7

−0.1

0−1.3

0.3

0.4

0−1.1

−1

−0.8−0.8

0.7

2−1.2

0.3

−0.22.1−0.3

0.2

1.6

2

2.1

0.2

1.1−0.50.7

0.8−0.5

0

−0.4

0.9

−0.9−0.5

−0.51.5

−0.2 0.80.9

0.20.30.3

−0.2

0.7−1.1

0.1

1.6

−0.7

−0.2

−2.7

−1.40.1

1.4

1.1

0.7

−0.2

−0.2

0.4

−0.3

−1.2

−0.6

−0.2

−2.8

−0.5 0

−1.7

0.1

−3.9

0.90.5

0.3

0.9

2.1

0.2−0.1

0.5

1.5

1.5

126

Page 130: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.3 Wind Speed 10m

0.0

1.5

3.4

5.4

7.9

13.8

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

2.7

2.2

1.3

1.3

1.4

2.1

1.7

1.8

2.2

1.5

1.5

1.6

1.5

2

1.6

1.1

1.4

1.6

1.61.8

1.8

2.2

1.3

2

1.8

1.6

1.2

1.1

1.3

1.2

1

1.3

1

1.1

1.3

1.8

1.4

1.5 1.11.7

0.91.5

1.4

1.1

1.3

2.4

1.4

1.1

1.2

1.3

1.9

1.51.4

1

2.31.3

1.3

1.6

1.9 1.4

1.6

1.3

1.3

1.7

1.3

1.3

1.1

1.3

1.4

1.7

1.3

1.51.1

1.7

1.7

1.71.5 1.9

2.32.12.2

2.1

2.11

1.5

1.2

1.21.2

1.41.3

1.21.31.21

1.6

1.4

1.51.5

1.5

1.5

1.5

1.3

2.12.4

2.12.9

3.42.21.9

2.41.4

1.21.51.8

1.82.2

1.31.41.3

1.6

1.9

1.6

1.9

2.11.9

1.6

1.4

2.4

1

1.71.3

1.9

2

1.4

3.2

1.5

1.6

22.9

1.51.9

1.5

1.91.11.9

2

2

1.31.9

1.31.4

1.8

1.9

1.71.5

2.2

2.22.22.31.81.8

31.51.9

2.22.3

1.9

2.6

1.8

1.9 1.6

1.7

1.8

2.41.82

2.8

1.82.7

1.9 1.8

2.72.8

2.1

2.5

21.3

2

1.71.9

2.1

1.9

2.3

1.8

1.81.7

2

1.7

2.1

1.72.2

1.7

1.8

1.82.1

2.2

2.42.3

3.23.12.4

1.7

1.62.21.9

1.8

2.4

2.4

2

2.1

21.72.4

2.12

2.21.8

2

2.61.6

1.92.3

2.1 2.42.4

2.41.92

2

22.2

2.4

2.1

1.7

3.1

3.6

3.12.3

2.12.5

3.2

2

2.12.2

1.3

1.8

2

2.62.8

2.5 2.2

2.3

1.3

2.9

22.32.7

1.7

2.4

1.51.3

1.9

2.1

2.6

127

Page 131: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 132: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.4 Max Mean Wind Speed 10m

8.4 Max Mean Wind Speed 10m

● ●

● ●

●●

●●

Lead time [h]

ME

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

−1.5

−1.0

−0.5

0.0

0.5

74 stations

AM25AM25_PPH8H8_PP

●●

●●

●● ●

● ●●

●●

● ●

●●

● ●

Lead time [h]

SDE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

2.0

2.5

3.0

3.5

74 stations

AM25AM25_PPH8H8_PP

●●

●●

●●

●●

Lead time [h]

MAE

[m/s

]

3 9 15 21 27 33 39 45 51 57 63

1.5

2.0

2.5

3.074 stations

AM25AM25_PPH8H8_PP

129

Page 133: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.4 Max Mean Wind Speed 10m

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Hit Rate

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

74 stations

●●

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

False Alarm Ratio

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

74 stations

●●

1 3 5 7 9 11 13 15 17 19 210.0

0.2

0.4

0.6

0.8

1.0

Equitable Threat Score

Exceedance threshold [m/s]

Lead time [h]: 00+3,+6,..,+24

AM25AM25_PPH8H8_PP

74 stations

130

Page 134: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.4 Max Mean Wind Speed 10m

0

●●

●●●

●●

AM25 AM25_PP H8 H8_PP

−4

−2

0

2

4

ME

Lead time [h]: 00+3,+6,..,+48 74 stations

●●●

●●●

●●

●●

●●

●●

AM25 AM25_PP H8 H8_PP

2

3

4

5

6

SDE

Lead time [h]: 00+3,+6,..,+48 74 stations

OBS

AM

25

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

15682 12033 32 0 0 27747

6207 40747 4534 164 35 51687

38 2120 3799 742 223 6922

0 48 232 254 141 675

0 3 22 26 55 106

21927 54951 8619 1186 454 87137

OBS

AM

25_P

P

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

15007 10662 21 0 0 25690

6859 40930 3377 86 14 51266

61 3246 4667 648 166 8788

0 98 486 359 155 1098

0 15 68 93 119 295

21927 54951 8619 1186 454 87137

OBS

H8

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

13707 10655 33 0 0 24395

8204 43072 5721 393 178 57568

16 1206 2747 634 189 4792

0 17 112 147 71 347

0 1 6 12 16 35

21927 54951 8619 1186 454 87137

OBS

H8_

PP

[0,3]

(3,11]

(11,17]

(17,21]

(21,Inf]

Sum

[0,3] (3,11] (11,17] (17,21] (21,Inf] Sum

12841 9099 19 0 0 21959

9038 42402 3776 202 63 55481

48 3323 4060 555 216 8202

0 115 676 305 97 1193

0 12 88 124 78 302

21927 54951 8619 1186 454 87137

Lead time [h]: 00+3,+6,..,+48 UTC 74 stations

131

Page 135: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 136: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.5 Wind gust

8.5 Wind gust

Lead time

ME

6 12 18 24 30 36 42 48 54 60 66

−1

0

1

267 stations

AM25_FGH8_FGAM25_925H8_925

●●

● ●

●●

Lead time

SDE

6 12 18 24 30 36 42 48 54 60 66

2.5

3.0

3.5

4.0

4.5

5.0

5.5

67 stations

AM25_FGH8_FGAM25_925H8_925

●●

● ●

●●

Lead time

MAE

6 12 18 24 30 36 42 48 54 60 66

2.0

2.5

3.0

3.5

4.0

67 stations

AM25_FGH8_FGAM25_925H8_925

133

Page 137: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.5 Wind gust

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Hit Rate

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

● ●● ● ● ●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

False Alarm Ratio

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

●●

0.3 3.4 8 10.8 17.2 20.8 24.5 28.5 32.70.0

0.2

0.4

0.6

0.8

1.0Lead time [h]: 00+3,+6,..,+24

Equitable Threat Score

Exceedance threshold

AM25_FGH8_FGAM25_925H8_925

67 stations

134

Page 138: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 139: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

8.6 Temperature 2m

●● ●

● ●●

●●

● ●

● ●

●●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63−1.5

−1.0

−0.5

0.0

0.5

81 stations

Lead Time

AM25H8ECMWFH12

● ●

● ●

●●

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.3

1.4

1.5

1.6

1.7

1.8

81 stations

Lead Time

AM25H8ECMWFH12

●●

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.1

1.2

1.3

1.4

1.5

81 stations

Lead Time

AM25H8ECMWFH12

136

Page 140: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

0

●●

●●

●●

●●

●●

AM25 H8 ECMWF H12

−2.0

−1.5

−1.0

−0.5

0.0

0.5

1.0

1.5

ME

Lead time [h]: 00+3,+6,..,+48 81 stations

●●●

●●

●●●

●●

AM25 H8 ECMWF H12

1.0

1.5

2.0

2.5

SDE

Lead time [h]: 00+3,+6,..,+48 81 stations

137

Page 141: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12ME at observing sites forecast means 01.03.2015 − 31.05.2015

0

0.1

−1.3

−0.4

−1.5

0.5

−0.4

−1

−0.9

−0.9

−0.9

−1.4

−1.7

−0.7

−0.2

−0.8

−1.4

−0.7

−1−1.4

−1.7

−1.9

−0.9

−0.8

−0.7

−0.7

−1.3

−0.8

−1.2

−0.3

−1.4

−0.2

−0.7

−0.9

−1

−1.4

0.1−0.2

−2.8

−0.4−1.4

−0.6

−1.3

−1

−1.1

−0.5

−1.4

−1.6

−1.4

−1

−1.9−1

−1.1

−1

−1.7

−1.2

−1.1

−1.9−1.6

−0.7

−1.3

−1.2

−1.2

−0.9

−0.9

−1

−1.4

−0.7

−1.1

−1.4

−1.2

−1.7−0.6

−2.1

−0.4

−1.1−2.2 −2.2

−2.3−1.1

−1.7−1.8

−0.9

−0.3

0.1

−1

−0.3−0.4

−0.3

−1.3 −1.2−1.1

−1.7−0.7

−0.9

−0.5−1.3

−1−2.2−0.9−1.1−0.7

−0.8−0.2−1.3−1

−1.4−1

−1.1

−0.9

−1.1

−0.6−0.9

−0.4

−0.6−1

−1.3

−0.9

−0.6−1

−1

−0.8

−0.20.6

−0.9

−1.2

−0.7−0.5−0.2

−0.9−0.2−0.8

−1−1.5−1.2

−1.1

−1.6−0.7

−1.8−0.8

−0.1

−0.2

−0.8

−1.2

−1.1

−0.5

−1.4−0.1

−0.8

−1.9

−0.5

−0.6

−1.1

−0.8−1.5

−0.6−1.2

−0.2

−1.4−0.5−0.6−0.5

−1.2

−1.1

−0.3−1.4−1.1

−0.7−1

−0.8

−0.6

−0.70.2

0.7−1.5

0.2

−0.2

0

−1.1−0.8

−0.4−0.40 −2.3

−1.50.2

0

−0.4−0.4 0.5

0.4

−1.2

−0.7

0.4

−1.2

−0.8

0.1 −0.8

−0.5

−0.2

−0.4

−0.8

−0.30.5

0.7

−1.80.6

−1.1 −0.1

−0.10.1−1.8

−1.2

−1.8−2

−0.2

−0.8

−0.2

−0.7

−1.2−0.4

−1.1

−0.5

−1

0.5

−0.6−1.1

−1.1−1.4

−0.6

−0.5

−0.3

−0.9−0.2−0.8

−0.9

−1

−0.8

−0.7

−0.6−1

−1.2

−0.3−0.2

−1

−1.5−1

−0.4

−0.3−1.2

−0.6

−0.6

−1.3

−1

−0.9

−0.2

−0.70.1−0.9

−1.2−0.7

−0.9−0.9 −1.1

−1

−0.5

−1−0.9

0.6−0.7

−0.3 −0.6−0.7

−0.9−0.7−0.4

−0.3

−0.4−0.40.2−0.6−1−0.5

−0.50.9

−0.8

−0.3

−1.1

0.5

0−0.6

−1.8−1.7

0.4

−1

−0.3

−1.3

−0.1

0.1

−0.5

−0.3

−0.2

0.4

−0.1 −0.6

−0.7

−0.5

0.5

−1.3−0.6

−1

−1.1

−0.4−0.2

−0.8

−1.5

−0.7

−0.8

−0.2

138

Page 142: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24ME at observing sites forecast means 01.03.2015 − 31.05.2015

−0.4

0.9

−0.3

0.1

0.3

0.4

0.7

0.2

0.6

0.2

−0.2

−1.1

−0.3

−0.3

−0.4

−1.3

0.1

0.1

−0.4−0.8

−0.9

−0.9

−0.9

−0.9

0.3

−0.3

−0.7

−0.6

1

−0.3

0.5

0.7

1.6−0.5

−0.5

−0.5

0−0.3

−0.2

−0.20.2

0

0

−0.7

−0.2

−0.1

−0.2

0.3

0

−0.5

−1.9−0.4

0

−1

0.2

0

−0.6

−0.7

−0.4

−0.3

−1.2

0.6

−0.7

−0.1

−0.8

−0.2

0.4

−0.5

−0.4

−0.6

0

−0.8−0.5

−0.5

−0.7

−0.4−0.2

−0.3

−0.4

−1.2−0.8

−0.7

−0.5

−1.1−0.7

−0.8

−0.2−0.4

−1

−0.5 0.5−0.3

0.6−1.2−1.1−1.20.1

−0.50.5−1.4−0.4−0.4

−0.4−10.6

−1.5

0.2−0.90.8

0.3

0.5

0.20.2

−0.8

−1.3−1.4

0

−0.4

−1.6−1.2−1

1

−0.4−1.6−0.6

−1.2

−0.8−0.6−0.4

−0.6−1.4−0.9

−0.20.5−0.2

−1.2

−0.1

0.6

0−1.5

−1.20.2

−0.3

−0.6

−0.8

−0.7

−0.7−1.1

−0.4

−0.4

−1.1

−0.7

0.5

−1.9−1.6

−0.1−0.4

1

−0.60.4−0.8−0.9

−0.8

−1

0.100.1

−0.3

−0.3

−0.6

0.2

−0.7−0.9

0

−1.9

−0.3

0.3

−0.8−0.7−1.50.1−0.7−0.3−1.6

−0.1−0.4−1

−0.2 −0.8 0

0.5

−1.2

−0.9

−1.1

−1.1 −0.90.1

0.3

−1.2

−0.7

−0.4

0−1.1

−1.1

−1.8−1.2

−0.1 −0.5−0.8−1.1−1.6

−0.3

−1.8−1

−1.1

−0.3

−1.2−0.6

0.1

−1.1

−0.5

−1

−1.5

−1

−0.4−0.7

−0.5−0.1

−0.6

−0.4

−0.8

−0.5−0.9−0.6−1.1

−0.6

−0.5

0.1

0−0.2

−0.2

−0.7−0.4

−1.5−1.7−1.9

−0.3

−0.5−0.3−0.6

−0.7

−0.4

0

−0.7

−0.7

−1.3−1.1−0.4

−1−0.8

−0.2−0.2 0

−0.2

−1

−0.7−1.6

0.90

−0.7 −0.9−0.4

−0.3−0.6−1.2

−0.3

−1.2−1.2−1.3−0.7−0.1−1.1

−1.2−0.2

−1.3

−1.1

−0.6

−0.9

0.1−0.9

−1.8−0.7

−0.8

−1.1

−0.2

0.1

−0.8

0.9

0

−0.8

−1−1

−0.6 −1.6

−1.2

0.2

−0.8

−1.7 −0.6

−0.5

−1.2

−0.6−0.8

0.4

−0.1

−0.2

−0.3

0

139

Page 143: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+12SDE at observing sites forecast means 01.03.2015 − 31.05.2015

1.7

2

1.5

1.5

1.6

1.4

1

1.5

1.4

1.3

1.4

1.4

1.3

1

1.2

1.1

1.4

1.2

1.41.3

1.5

1.5

1.4

1.6

1.3

1.81.8

1.9

1.6

1.7

1.9

1.61.4

1.1

1

1.1

1.6 1.81.8

1.71.1

1.3

1.4

1.1

1.4

1.5

1.9

1.9

1.7

1.4

1.41.7

1.4

1.41.6

1.4

1.3

1.61.5

1.4

1.4

1.3

1.6

1.5

1.6

1.3

1.6

1.4

1.2

0.9

1.6

1.51.2

1.4

0.7

11.1 1.3

1.71.1

1.31.3

1

1.31.1

1

1.21.3

1.41.7 1.51.5

1.51.31.5

1.61.51.41.71.5

1.51.4

1.31.41.61.7

1.31.2

1.6

1.6

1.2

1.61.2

1.7

1.11.1

1.41.3

1.11.3

1.21.7

2.41.31.4

1.6

1.61.21.8

1.71.21.4

1.41.71.5

1.62.3

1.9

1.31.3

1.10.8

1.5

1

1.6

1.40.9

1.6

1.5

1.4

1.5

1.3

1

1.11.1

1.51.1

1.41.31.31.31.3

1.2

1

1.11.21.2

0.80.8

1.1

1.1

11.2

1.71.3

2.21.2

1.51.31.31.41.21.5 1.4

2.11.41.4

1.1 1.61.6

2.2

1.4

2.4

1.3

1.4 1.71.6

1.3

1.1

1.2

0.9

1.21.2

1.1

1.91.4

1 1.42.11.31.9

1

2.11.4

1.7

1

1.31.3

1.21.1

1.3

1.1

1.4

1.8

1.31.2

1.41.5

1.3

1.3

1.2

1.51.51.51.2

1.3

1.3

1.3

11

1

1.11

1.3

1.71.3

0.9

11.11.1

1.1

1.4

1.3

1.2

1.4

1.41.61.2

1.11

0.81.3 1.1

1.3

1.2

1.11.3

0.80.8

1 11.2

1.10.91.4

1.1

1.11.10.91.21.21.2

1.21.2

1.3

1.5

1.4

1.6

1.10.9

1.31.31.1

1.3

1.1

1.6

1.1

1.5

1.5

1.1

1.11.2

0.8 1

1.3

1.31.5

1.3 1.1

1.3

1.3

1.11.21.1

1.6

1.2

1.2

0.7

140

Page 144: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.6 Temperature 2m

−30

−25

−20

−15

−10

−5

0

5

10

15

20

25

30

AM25 00+24SDE at observing sites forecast means 01.03.2015 − 31.05.2015

2.2

3.9

2.5

2.7

3.2

3.2

3.7

3.3

2.6

2

2.3

1.7

1.8

1.4

1.3

1.1

1.6

2.1

1.71

0.9

1.1

1.3

1.2

1.6

1.6

1.3

1.4

2.1

1.1

1.7

1.3

2.4

0.9

0.7

0.8

1.1 1.60.9

1.31

1.1

1.8

0.9

2.6

2.4

3.1

2.4

2.2

1.7

1.5

2.1

1.9

1.2

2.3

2.30.9

0.9

1.4

1.3

1.1

2.1

1.4

1.5

1.8

1.6

1.8

1.2

1.4

0.8

1.6

11.1

0.9

0.6

0.70.7

0.9

11.2

11.1

0.8

1.11.3

1.1

1.71.6

1.6

1.4 2.11.71.81.7

1.61.6

2.11.52.11.3

1.61.7

1.61.41.91.9

2.11.3

2.7

2.2

3

2.42.9

1.6

1.91.5

2.73.5

2.31.9

1.63.1

21.3

1.9

1.3

1.921.7

1.91.32.7

1.82.21.6

1.8

1.8

2

2.31.5

1.92.9

1.5

1.1

1.7

1.5

0.91.5

1.9

1.2

1.7

1.8

2.3

2.22.4

1.80.9

1.7

1.21.81.61.3

1.8

2.2

1.611.3

0.9

0.8

1.5

1.6

1.41

1.61.7

2.12.2

1.52.71.51.61.21.6 1.8

1.31.41.2

1.3 1.6

2.6

1.5

2.3

1.5

1.6 1.5 1.9

1.4

1.1

1.2

1

2.21.4

1.3

2.31.3

1.3 1.31.71.42.2

0.8

1.82.1

1.8

0.9

1.21.2

0.9

1.1

1.5

1.1

1.6

1.5

2.21.9

1.61.7

1.6

1.4

1.3

1.61.51.51.3

1.5

1.7

1.6

1.41

0.9

10.9

2

1.61.4

1.1

1.311.2

1.4

1.5

1.7

2.1

2

1.71.82.5

2.41.1

11.8 2

1.7

1.4

0.91.6

0.80.8

1.2 11

1.411.1

1.1

1.31.31.41.51.91.3

0.91

1.3

2.3

1.1

1.3

11

1.82.11.8

1.8

1.2

1.5

1.3

3.1

2.9

1.6

1.2

1.6

0.9 0.9

1.9

3.11.6

1.61.1

2.4

1.1

1.31.32.2

2.4

0.8

0.9

0.9

141

Page 145: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 146: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.7 Post processed temperature 2m

8.7 Post processed temperature 2m

●● ●

● ●● ●

● ●

●●

●●

ME

ME

[C]

3 9 15 21 27 33 39 45 51 57 63

−1.0

−0.5

0.0

0.5

81 stations

Lead Time

AM25AM25.KFH8H8.KF

● ●

● ●

●●

●●

SDE

SD

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.2

1.3

1.4

1.5

1.6

1.7

1.8

1.981 stations

Lead Time

AM25AM25.KFH8H8.KF

● ●

●●

MAE

MA

E [C

]

3 9 15 21 27 33 39 45 51 57 63

1.0

1.1

1.2

1.3

1.4

81 stations

Lead Time

AM25AM25.KFH8H8.KF

143

Page 147: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.7 Post processed temperature 2m

0

●●

●●

●●

●●

AM25 AM25.KF H8 H8.KF

−1

0

1

2

3

ME

Lead time [h]: 00+3,+6,..,+48 81 stations

●●●

●●

●●●

●●

●●

●●

AM25 AM25.KF H8 H8.KF

1.0

1.5

2.0

2.5

SDE

Lead time [h]: 00+3,+6,..,+48 81 stations

144

Page 148: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 149: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.8 Daily precipitation

8.8 Daily precipitation

ME

[mm

]

30 54

−0.5

0.0

0.5

1.0

1.5

2.0103 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

SDE

[mm

]

30 542.5

3.0

3.5

4.0

4.5

5.0103 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

MAE

[mm

]

30 541.5

2.0

2.5

3.0

103 stations

Lead Time [h]

AM25AM25.medECMWFH8H12

146

Page 150: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.8 Daily precipitation

●●

● ●

HR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

103 stationsLead time [h]: 00+30

Exceedance threshold [mm]

●●

●●

● ●

FAR

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

103 stationsLead time [h]: 00+30

Exceedance threshold [mm]

● ●

ETS

0 1 2 4 8 16 25 35 45 60 80 1000.0

0.2

0.4

0.6

0.8

1.0

AM25AM25.medECMWFH8H12

103 stationsLead time [h]: 00+30

Exceedance threshold [mm]

147

Page 151: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.8 Daily precipitation

0

●●

●●

●●

●●

●●

AM25 AM25.med ECMWF H8 H12

−4

−2

0

2

4

ME

Lead time [h]: 00+30,+54 103 stations

●●

●●

●●

●●●

●●

●●

●●

AM25 AM25.med ECMWF H8 H12

0

2

4

6

8

SDE

Lead time [h]: 00+30,+54 103 stations

OBS

AM

25

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

1349 483 16 0 0 1848

1754 5085 771 6 0 7616

114 1356 1824 165 1 3460

4 12 144 102 1 263

0 0 0 1 0 1

3221 6936 2755 274 2 13188

OBS

AM

25.m

ed

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

1447 582 18 0 0 2047

1693 5328 936 10 0 7967

81 1018 1703 169 0 2971

0 8 98 95 2 203

0 0 0 0 0 0

3221 6936 2755 274 2 13188

OBS

EC

MW

F

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

919 217 4 0 0 1140

2173 4924 572 10 0 7679

126 1779 1934 100 0 3939

3 16 245 164 2 430

0 0 0 0 0 0

3221 6936 2755 274 2 13188

OBS

H8

[0,0.1]

(0.1,5]

(5,20]

(20,50]

(50,Inf]

Sum

[0,0.1] (0.1,5] (5,20] (20,50] (50,Inf] Sum

519 130 6 0 0 655

2538 5095 846 7 0 8486

163 1699 1837 198 0 3897

1 12 66 69 2 150

0 0 0 0 0 0

3221 6936 2755 274 2 13188

Lead time [h]: 00+30,+54 103 stations

148

Page 152: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 153: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.8 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30ME at observing sites forecast means 01.03.2015 − 31.05.2015

1.4

1.1

0.30.1

0.3

−0.1 0.5

0.20.3

0.4

0.6−0.1

0.310.3

0.90.7

0.70.50.4

0.4

0.80.7

1

0.60.5

0.6

01.2

0.6

1.2

0.5

0.5

1.3

0.4

0.8

0.31.21.9

0.40

0.5

1

0.50.6

0.7

1.6

0.3

−0.50.2

0.4

0.3

0.6

0.50.5

0.30.7

0.5

0.2

0.2

0.6

0.7

0.30.6

−0.2

−0.5

−0.6

−2.2−1.1

0.5

−0.1

−0.4

2.4

1.63.4

10.4−0.60.6 0.5

−1.3−0.3

−0.5

1.5

−2.1 −0.5

0.3

2.5

4.5

2.2 −0.3

1.8 4.12.3

1.52.61.7

0

5.23.3

2

0.9

−0.2

0.6

0.5

1.6

0.8

1

1.51.2

1

0.5

1.10.3

0.7

0.5

0.7

1.7

1.8

0.30.8 0.5

0.3

0.1

0.2

1.9

1.1

0.2−0.3

0.6 1.2

1.2

0.9

0.1

0.7

0.10.91.10.8

0.4

1.3

1.7

0.1

0.8 0.6

0.1

0.3

0.2

150

Page 154: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

8 NORTHERN NORWAY 8.8 Daily precipitation

012

4

7

10

15

20

25

30

AM25 00+30SDE at observing sites forecast means 01.03.2015 − 31.05.2015

2.8

3

2.82.3

2

2.6 2.6

2.72.4

1.4

2.62.52.33.62.9

2.43.5

2.12.21.7

2.2

33.6

3.1

2.41.3

2.7

1.62.2

2.2

2.8

1.8

2.6

2.7

2

2.6

1.62.53.8

2.12.2

2.2

2.4

1.41.6

2

4.1

2.4

2.62.5

2.7

2.1

1.8

1.72.2

5.13.2

2.5

2.82.2

2.4

1.8

4.73.8

2.7

3.2

4

6.44.1

5.35.2

6.83.2

3.95.6744.43.3 4.3

5.954.7

8.56.7 2.4

5.8

6.2

7.9

6.3 8.54.3 6.75.4

5.16.85.1

3.5

7.65.4

4.6

2.73.5

4.9

3.1

3.8

2.2

1.8

2.8 3

2.5

4.3

3.43.2

3.1

3.1

3.4

3.7

3.4

2.72.8 2.9

3.9

4

2.7

3.5

3.53.5

3.4

3.4 2.8

3.4

2.9

2.1

3.1

1.72.32.83.4

2.9

2

2.9

3.8

1.4 1.9

2.2

2.2

1.6

151

Page 155: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 Long term forecast

9.1 Comments to the verification results

Temperature 2m:

Negative bias with a slight cold trend for both the deterministic ECMWF and also the uncali-

brated probabilistic forecast. A small positive bias for the calibrated forecast. This is a clear

improvement from the winter season.

SDE is also significantly reduced compared with the winter. Still small differences between the

deterministic ECMWF and probabilistic forecast up to 160h, where SDE is increased for the

deterministic forecast. There is a clear improvement from calibration in MAE for all lead times.

Actually, the uncalibrated probabilistic forecast has higher MAE than the deterministic forecast

up to around 138h. MAE is also reduced compared with the winter season.

Wind speed 10m:

Negative biases for both deterministic and probabilistic forecast. Clear diurnal variations, with

the most bias during daytime. SDE and MAE clearly lower for the probabilistic forecast after

around 100h. ETS is quite similar for both forecasts after 72h, and after 216h, the probabilistic

forecast is slightly better for low thresholds. Still the overall score is low.

Precipitation:

Small positive bias for the deterministic forecast. Mostly negative bias for the probabilistic fore-

cast, with a clear dry trend. Median drier than the consensus forecast. SDE and MAE higher

for the deterministic forecast after around 100h. The deterministic forecast scores better at ETS

for the first part of the long term forecast. At 222 and 234, the overall score is very low for both

forecast, yet the probabilistic forecast is slightly better at lower threshold and ECMWF is slightly

better at higher threshold.

Page 156: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.2 Temperature 2m

9.2 Temperature 2m

● ●

●●

● ●

● ●● ●

● ●● ●

● ●● ●

● ●● ●

● ●● ●

●●

● ●

●●

● ●

●●

Lead time [h]

[C]

ME

0 18 36 54 72 90 114 138 162 186 210 234−2

−1

0

1

270 stations

EC_UKAL_KONSENSUSEC_UKAL_MEDIANECMWFEC_KAL_KONSENSUSEC_KAL_MEDIAN

●●

● ●

●●

● ●

● ●

● ●

●●

● ●●

● ●●

●●

●●

● ●●

●●

Lead time [h]

[C]

SDE

0 18 36 54 72 90 114 138 162 186 210 234

1.5

2.0

2.5

3.0

3.5

270 stations

EC_UKAL_KONSENSUSEC_UKAL_MEDIANECMWFEC_KAL_KONSENSUSEC_KAL_MEDIAN

● ●

● ● ●

● ● ●

● ● ●

● ●

● ●

●●

●●

●●

●●

Lead time [h]

[C]

MAE

0 18 36 54 72 90 114 138 162 186 210 234

1.5

2.0

2.5

3.0

270 stations

EC_UKAL_KONSENSUSEC_UKAL_MEDIANECMWFEC_KAL_KONSENSUSEC_KAL_MEDIAN

153

Page 157: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 158: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.3 Wind Speed 10m

9.3 Wind Speed 10m

●●

ME

Lead time [h]

[m/s

]

6 24 42 60 78 96 120 144 168 192 216

−1.0

−0.5

0.0

0.5225 stations

EC_KONSENSUSEC_MEDIANECMWF

● ● ● ●●

● ●●

●● ● ●

●● ● ●

●● ●

●●

●●

●●

●●

● ●

●●

● ●

●●

SDE

Lead time [h]

[m/s

]

6 24 42 60 78 96 120 144 168 192 2161.8

2.0

2.2

2.4

2.6

2.8

3.0

3.2225 stations

EC_KONSENSUSEC_MEDIANECMWF

● ● ● ● ●●

● ● ●

● ● ●●

● ●●

● ●●

●●

●●

● ● ● ● ● ● ● ● ● ●● ●

MAE

Lead time [h]

[m/s

]

6 24 42 60 78 96 120 144 168 192 216

1.8

2.0

2.2

2.4

2.6

225 stations

EC_KONSENSUSEC_MEDIANECMWF

155

Page 159: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.3 Wind Speed 10m

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 72 Hit Rate 225 stations

EC_KONSENSUSEC_MEDIANECMWF

● ●

●●

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 72 False Alarm Ratio 225 stations

EC_KONSENSUSEC_MEDIANECMWF

● ●

●●

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 72 Equitable Threat Score 225 stations

EC_KONSENSUSEC_MEDIANECMWF

156

Page 160: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.3 Wind Speed 10m

● ●

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 216 Hit Rate 225 stations

EC_KONSENSUSEC_MEDIANECMWF

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 216 False Alarm Ratio 225 stations

EC_KONSENSUSEC_MEDIANECMWF

●● ●

1 3 5 7 9 11 15 19 23 27 310.0

0.2

0.4

0.6

0.8

1.0

Exceedance threshold [m/s]

Lead time [h]: 216 Equitable Threat Score 225 stations

EC_KONSENSUSEC_MEDIANECMWF

157

Page 161: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 162: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.4 12h Precipitation

9.4 12h Precipitation

● ●●

● ●● ●

● ●●

●●

● ●

●●

ME

Lead time [h]

[mm

]

18 42 66 90 114 138 162 186 210 234

−1.5

−1.0

−0.5

0.0

0.5

1.0

1.5 236 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

● ●●

●● ● ●

● ●● ●

●●

SDE

Lead time [h]

[mm

]

18 42 66 90 114 138 162 186 210 234

2

3

4

5

236 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

● ●●

●● ● ●

●● ● ● ●

● ●

●●

MAE

Lead time [h]

[mm

]

18 42 66 90 114 138 162 186 210 234

1.0

1.5

2.0

2.5

3.0236 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

159

Page 163: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.4 12h Precipitation

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Hit Rate

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 78

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0False Alarm Ratio

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 78

●●

● ●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Equitable Threat Score

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 78

160

Page 164: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.4 12h Precipitation

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Hit Rate

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 90

● ●

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0False Alarm Ratio

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 90

● ●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Equitable Threat Score

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 90

161

Page 165: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.4 12h Precipitation

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Hit Rate

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 222

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0False Alarm Ratio

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 222

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Equitable Threat Score

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 222

162

Page 166: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.4 12h Precipitation

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Hit Rate

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 234

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0False Alarm Ratio

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 234

●●

0 0.1 1 2 4 8 12 20 30 40 500.0

0.2

0.4

0.6

0.8

1.0Equitable Threat Score

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

236 stations

Exceedance threshold

Lead time [h]: 234

163

Page 167: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 168: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.5 24h Precipitation

9.5 24h Precipitation

Lead time [h]

[mm

]

ME

30 54 78 102 126 150 174 198 222

−3

−2

−1

0

1

531 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

●●

● ●

Lead time [h]

[mm

]

SDE

30 54 78 102 126 150 174 198 222

4.5

5.0

5.5

6.0

6.5

7.0

531 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

● ●

●●

Lead time [h]

[mm

]

MAE

30 54 78 102 126 150 174 198 222

3.0

3.5

4.0

4.5

5.0 531 stations

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

165

Page 169: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.5 24h Precipitation

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0Hit RateLead time [h]: 78

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

●●

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0False Alarm RatioLead time [h]: 78

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

●●

●●

●●

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0Equitable Threat ScoreLead time [h]: 78

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

166

Page 170: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

9 LONG TERM FORECAST 9.5 24h Precipitation

●● ●

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0Hit RateLead time [h]: 222

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

● ●

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0False Alarm RatioLead time [h]: 222

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

●●

● ● ●

0 1 2 4 8 16 25 35 45 60 800.0

0.2

0.4

0.6

0.8

1.0Equitable Threat ScoreLead time [h]: 222

ECMWFEC_UKAL_KONSENSUSEC_UKAL_MEDIAN

531 stations

Exceedance threshold [mm]

167

Page 171: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 172: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX

10 Appendix

10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

2

4

6

8

10

12

14

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

2

4

6

8

10

12

14

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

2

4

6

8

10

12

14

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.3 3.8 12.2 2.4 368

AM25: 12+18,+24,+30,+36 0.1 4.2 13.8 2.9 363

Hirlam8: 12+18,+24,+30,+36 0.2 5.2 12.8 2.6 368

ECMWF: 12+18,+24,+30,+36 0.3 2.5 7.4 1.2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.3 1.9 1.9 1.5 7.7 363

Hirlam8 − synop 1.3 1.8 2.2 1.8 7.8 368

ECMWF − synop −1.3 1.8 2.3 1.7 7.4 368

01.03.2015 − 31.05.2015

TROMSØ

169

Page 173: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.4 6.4 20.4 3.5 368

AM25: 12+18,+24,+30,+36 0.5 5.3 15.5 3 363

Hirlam8: 12+18,+24,+30,+36 0.4 6.3 17.7 3.2 368

ECMWF: 12+18,+24,+30,+36 0.4 6 17.2 3.3 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.1 1.9 2.2 1.7 8.2 363

Hirlam8 − synop −0.1 1.9 1.9 1.5 5.2 368

ECMWF − synop −0.4 1.9 1.9 1.5 7.9 368

01.03.2015 − 31.05.2015

ØRLAND

170

Page 174: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0 7.7 21.9 4.3 316

AM25: 12+18,+24,+30,+36 0.5 8.2 21.9 4.3 363

Hirlam8: 12+18,+24,+30,+36 0.4 8 21 4.2 368

ECMWF: 12+18,+24,+30,+36 0.1 7.7 18.8 3.9 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.8 2.5 2.6 2.1 8.1 311

Hirlam8 − synop 0.5 2.4 2.5 1.9 8 316

ECMWF − synop 0.2 2.3 2.3 1.8 7.7 316

01.03.2015 − 31.05.2015

YTTERØYANE FYR

171

Page 175: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

2

4

6

8

10

12

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

2

4

6

8

10

12

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

2

4

6

8

10

12

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0 3.7 12.8 2.2 367

AM25: 12+18,+24,+30,+36 0.2 3.3 12.1 1.9 363

Hirlam8: 12+18,+24,+30,+36 0.1 3.6 11.1 2 368

ECMWF: 12+18,+24,+30,+36 0.5 3.8 11.6 2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.4 1.4 1.5 1.2 5.4 362

Hirlam8 − synop −0.1 1.5 1.5 1.2 4.7 367

ECMWF − synop 0 1.6 1.6 1.2 5.7 367

01.03.2015 − 31.05.2015

BERGEN − FLORIDA

172

Page 176: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.2 6.4 19.3 4.4 367

AM25: 12+18,+24,+30,+36 0.1 7.2 19.4 4.2 363

Hirlam8: 12+18,+24,+30,+36 0.5 5.3 12.8 2.6 368

ECMWF: 12+18,+24,+30,+36 0 3 7.8 1.5 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.9 2.5 2.6 2.1 10.9 362

Hirlam8 − synop −1 2.7 2.9 2.3 8.4 367

ECMWF − synop −3.3 3.3 4.7 3.6 13.2 367

01.03.2015 − 31.05.2015

FINSEVATN

173

Page 177: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

2

4

6

8

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

2

4

6

8

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

2

4

6

8

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.1 1.6 7.3 1.3 368

AM25: 12+18,+24,+30,+36 0.1 1.8 9 1.4 363

Hirlam8: 12+18,+24,+30,+36 0.2 2.2 5.8 1.2 368

ECMWF: 12+18,+24,+30,+36 0 2.3 5.6 1.1 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.2 1.2 1.2 0.9 6.4 363

Hirlam8 − synop 0.6 1.2 1.3 1.1 3.4 368

ECMWF − synop 0.7 1.2 1.4 1.1 4.1 368

01.03.2015 − 31.05.2015

NESBYEN

174

Page 178: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.5 7.6 16.5 3.2 368

AM25: 12+18,+24,+30,+36 0.4 8.4 18.3 3.5 363

Hirlam8: 12+18,+24,+30,+36 0.3 8.4 18 3.4 368

ECMWF: 12+18,+24,+30,+36 0.2 8.1 16.2 3.2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.9 2 2.1 1.5 10.8 363

Hirlam8 − synop 0.8 1.8 2 1.4 10.5 368

ECMWF − synop 0.5 1.6 1.7 1.2 7.3 368

01.03.2015 − 31.05.2015

EKOFISK

175

Page 179: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0 4.8 15.1 2.8 364

AM25: 12+18,+24,+30,+36 0.3 4.2 14.2 2.3 363

Hirlam8: 12+18,+24,+30,+36 0.1 4.7 13.5 2.3 368

ECMWF: 12+18,+24,+30,+36 0.3 5 14.3 2.3 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.5 1.6 1.6 1.3 6.4 359

Hirlam8 − synop −0.1 1.7 1.7 1.3 5.5 364

ECMWF − synop 0.2 1.6 1.7 1.3 6 364

01.03.2015 − 31.05.2015

SOLA

176

Page 180: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.5 7.4 18.6 3.6 368

AM25: 12+18,+24,+30,+36 0.1 7.2 16.4 3.5 363

Hirlam8: 12+18,+24,+30,+36 0.3 7 16.7 3.4 368

ECMWF: 12+18,+24,+30,+36 0.4 6.5 15 3.2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.1 1.9 1.9 1.5 7.6 363

Hirlam8 − synop −0.4 2.1 2.1 1.6 7 368

ECMWF − synop −0.8 1.7 1.9 1.5 6.4 368

01.03.2015 − 31.05.2015

FERDER FYR

177

Page 181: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.1 10m Wind speed

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

2

4

6

8

idate

01.03.2015 − 31.03.2015

m/s

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

2

4

6

8

idate

01.04.2015 − 30.04.2015

m/s

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

2

4

6

8

idate

01.05.2015 − 31.05.2015

m/s

Min Mean Max Std N

synop: 00,06,12,18 0.3 3 9.2 1.7 368

AM25: 12+18,+24,+30,+36 0.1 2.7 7.9 1.6 363

Hirlam8: 12+18,+24,+30,+36 0.1 3.5 8.5 1.8 368

ECMWF: 12+18,+24,+30,+36 0 2.9 7.1 1.3 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.3 1.3 1.4 1 4.5 363

Hirlam8 − synop 0.5 1.6 1.7 1.3 5.4 368

ECMWF − synop −0.1 1.4 1.4 1.1 4.7 368

01.03.2015 − 31.05.2015

OSLO − BLINDERN

178

Page 182: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 183: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

−10

−5

0

5

10

15

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

−10

−5

0

5

10

15

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

−10

−5

0

5

10

15

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −7.7 3 15.7 3.5 368

AM25: 12+18,+24,+30,+36 −7.6 2.2 12.9 3.5 363

Hirlam8: 12+18,+24,+30,+36 −6.4 2.1 12.3 3.3 368

ECMWF: 12+18,+24,+30,+36 −10.9 0.6 14 4.2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.8 1.3 1.5 1.2 4.9 363

Hirlam8 − synop −1 1.4 1.7 1.3 5 368

ECMWF − synop −2.4 1.6 2.9 2.4 8.4 368

01.03.2015 − 31.05.2015

TROMSØ

180

Page 184: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −2.6 6 15.5 3 368

AM25: 12+18,+24,+30,+36 −3.9 5.2 15.2 3 363

Hirlam8: 12+18,+24,+30,+36 −1.6 5.7 14.3 2.6 368

ECMWF: 12+18,+24,+30,+36 −0.2 5.1 13.7 2.4 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.7 1.2 1.4 1.1 5.3 363

Hirlam8 − synop −0.3 1.2 1.3 1 4.5 368

ECMWF − synop −0.9 1.2 1.5 1.2 5 368

01.03.2015 − 31.05.2015

ØRLAND

181

Page 185: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

2

4

6

8

10

12

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

2

4

6

8

10

12

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

2

4

6

8

10

12

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 1.7 6.2 11.9 1.9 364

AM25: 12+18,+24,+30,+36 1.8 5.7 10 1.6 363

Hirlam8: 12+18,+24,+30,+36 2.9 6.3 10.2 1.5 368

ECMWF: 12+18,+24,+30,+36 2.1 5.8 9.4 1.6 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.5 0.9 1.1 0.8 4.2 359

Hirlam8 − synop 0 1 1 0.7 5.6 364

ECMWF − synop −0.4 0.9 1 0.7 5.1 364

01.03.2015 − 31.05.2015

YTTERØYANE FYR

182

Page 186: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

−5

0

5

10

15

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

−5

0

5

10

15

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

−5

0

5

10

15

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −1.9 6.7 18.2 3.1 368

AM25: 12+18,+24,+30,+36 −1.9 5.2 16.2 2.9 363

Hirlam8: 12+18,+24,+30,+36 −3.9 4.9 13.8 3 368

ECMWF: 12+18,+24,+30,+36 −4.2 4.7 12 2.9 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.5 1.3 2 1.7 6.2 363

Hirlam8 − synop −1.7 1.2 2.1 1.8 6.9 368

ECMWF − synop −1.9 1.2 2.3 2 6.2 368

01.03.2015 − 31.05.2015

BERGEN − FLORIDA

183

Page 187: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

−20

−15

−10

−5

0

5

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

−20

−15

−10

−5

0

5

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

−20

−15

−10

−5

0

5

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −19.2 −3 7.2 4 368

AM25: 12+18,+24,+30,+36 −17.9 −4.7 3.5 3.4 363

Hirlam8: 12+18,+24,+30,+36 −14.8 −4.3 5.6 3.2 368

ECMWF: 12+18,+24,+30,+36 −11 −3.8 4.8 2.9 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.7 2.1 2.7 2.3 10.6 363

Hirlam8 − synop −1.3 2.2 2.5 2.1 9.6 368

ECMWF − synop −0.7 2.4 2.6 1.9 12.5 368

01.03.2015 − 31.05.2015

FINSEVATN

184

Page 188: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

−10

−5

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

−10

−5

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

−10

−5

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −10.8 4.6 21.6 5.5 368

AM25: 12+18,+24,+30,+36 −7.7 3.1 15 4.2 363

Hirlam8: 12+18,+24,+30,+36 −12.6 0.6 14.6 4.5 368

ECMWF: 12+18,+24,+30,+36 −11.4 0 14.8 4.6 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.5 2.2 2.7 2.2 7.3 363

Hirlam8 − synop −4 2.2 4.6 4.1 9.2 368

ECMWF − synop −4.6 2.4 5.2 4.7 10.8 368

01.03.2015 − 31.05.2015

NESBYEN

185

Page 189: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

2

4

6

8

10

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

2

4

6

8

10

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

2

4

6

8

10

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 2.9 6.9 11.5 1.7 368

AM25: 12+18,+24,+30,+36 3.2 6.9 10 1.5 363

Hirlam8: 12+18,+24,+30,+36 2.3 7 10.1 1.5 368

ECMWF: 12+18,+24,+30,+36 2.8 7.1 10.5 1.5 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0 1 1 0.7 3.8 363

Hirlam8 − synop 0.2 1.1 1.2 0.8 7 368

ECMWF − synop 0.2 0.9 0.9 0.7 3.9 368

01.03.2015 − 31.05.2015

EKOFISK

186

Page 190: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −2.6 6.7 13.5 2.8 367

AM25: 12+18,+24,+30,+36 −1.6 5.7 13.7 2.8 363

Hirlam8: 12+18,+24,+30,+36 −4 5.8 12.2 2.8 368

ECMWF: 12+18,+24,+30,+36 −0.3 5.7 11.7 2.2 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1 1.2 1.6 1.3 6 362

Hirlam8 − synop −0.9 1.2 1.5 1.2 5.4 367

ECMWF − synop −1 1.2 1.5 1.3 4.5 367

01.03.2015 − 31.05.2015

SOLA

187

Page 191: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −0.1 6.9 15.3 2.8 368

AM25: 12+18,+24,+30,+36 −1.8 6 13.1 2.9 363

Hirlam8: 12+18,+24,+30,+36 −2.1 6.1 13 3.1 368

ECMWF: 12+18,+24,+30,+36 −0.6 6.5 13.1 2.8 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −0.9 1 1.3 1 7.2 363

Hirlam8 − synop −0.8 1.2 1.5 1.1 7.1 368

ECMWF − synop −0.4 0.9 0.9 0.7 7.9 368

01.03.2015 − 31.05.2015

FERDER FYR

188

Page 192: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.2 Temperature 2m

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

−5

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

Cels

ius

Mar 31 Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

−5

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

Cels

ius

Apr 30 May 05 May 10 May 15 May 20 May 25 May 30

−5

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

Cels

ius

Min Mean Max Std N

synop: 00,06,12,18 −4.4 6.6 20.6 4.3 368

AM25: 12+18,+24,+30,+36 −4.4 5.5 16.7 4.2 363

Hirlam8: 12+18,+24,+30,+36 −6 4.4 15 4.5 368

ECMWF: 12+18,+24,+30,+36 −7.8 4.4 17.3 4.6 368

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.1 1.5 1.8 1.5 5.8 363

Hirlam8 − synop −2.2 2 3 2.4 9.2 368

ECMWF − synop −2.2 1.6 2.7 2.3 7.5 368

01.03.2015 − 31.05.2015

OSLO − BLINDERN

189

Page 193: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper
Page 194: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 2.3 14.9 3.3 91

AM25: 00+30 0 2.7 15.9 3.4 90

Hirlam8: 00+30 0 3.6 20.5 4.2 92

ECMWF: 00+30 0 3.9 20.5 4.5 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.4 2 2.1 1.3 6.9 89

Hirlam8 − synop 1.4 2.6 3 1.9 11.7 91

ECMWF − synop 1.6 2.7 3.1 2 12.4 91

01.03.2015 − 31.05.2015

TROMSØ

191

Page 195: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 2.2 18.9 3.5 91

AM25: 00+30 0 3.3 20 4.6 90

Hirlam8: 00+30 0 3.5 15 4 92

ECMWF: 00+30 0 3.8 19.7 4.7 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 1.1 3.2 3.4 1.9 18.3 89

Hirlam8 − synop 1.3 3.5 3.7 2.4 12.6 91

ECMWF − synop 1.7 2.9 3.3 2.1 13.3 91

01.03.2015 − 31.05.2015

BODØ

192

Page 196: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

5

10

15

20

25

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

5

10

15

20

25

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

5

10

15

20

25

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 2.2 19.8 3.6 92

AM25: 00+30 0 3.5 18.3 4.6 90

Hirlam8: 00+30 0 3.6 17.6 4.4 92

ECMWF: 00+30 0 4 24.9 4.6 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 1.2 3.2 3.5 1.9 18 90

Hirlam8 − synop 1.3 3.1 3.4 2.1 14.4 92

ECMWF − synop 1.8 2.4 3 2.1 10.2 92

01.03.2015 − 31.05.2015

ØRLAND

193

Page 197: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

20

40

60

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

20

40

60

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

20

40

60

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 7.9 66.5 11.4 92

AM25: 00+30 0 6.6 74.1 10.3 90

Hirlam8: 00+30 0 5.3 45.1 6.8 92

ECMWF: 00+30 0 7.3 47.9 8.2 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop −1.3 5.3 5.4 3.3 18.3 90

Hirlam8 − synop −2.6 7.4 7.8 4.3 39.2 92

ECMWF − synop −0.6 5.2 5.3 3.2 20.3 92

01.03.2015 − 31.05.2015

BERGEN − FLORIDA

194

Page 198: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

10

20

30

40

50

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

10

20

30

40

50

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

10

20

30

40

50

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 1.3 8.2 2.2 84

AM25: 00+30 0 5.2 43.4 7.7 90

Hirlam8: 00+30 0 4.4 23 4.6 92

ECMWF: 00+30 0 4.3 49 6.7 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 3.7 5.8 6.9 3.9 23.7 82

Hirlam8 − synop 3.3 3.5 4.8 3.3 15.4 84

ECMWF − synop 3.2 5.6 6.4 3.4 40.9 84

01.03.2015 − 31.05.2015

LÆRDAL

195

Page 199: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

10

20

30

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

10

20

30

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

10

20

30

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 2.3 24.3 4.7 92

AM25: 00+30 0 2.5 37.3 5.2 90

Hirlam8: 00+30 0 2.4 21 3.8 92

ECMWF: 00+30 0 2.5 19.2 4.2 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.3 2.3 2.4 1.1 13 90

Hirlam8 − synop 0.1 2.5 2.5 1.3 12.9 92

ECMWF − synop 0.2 2.4 2.4 1.2 13 92

01.03.2015 − 31.05.2015

GARDERMOEN

196

Page 200: Verification of Experimental and Operational Weather ... · 4 VERIFICATION MEASURES 3.5 Boundaries and initialization of upper air fields 3.5 Boundaries and initialization of upper

10 APPENDIX 10.3 Daily precipitation

Mar 01 Mar 06 Mar 11 Mar 16 Mar 21 Mar 26 Mar 31

0

10

20

30

40

idate

01.03.2015 − 31.03.2015

mm

Apr 05 Apr 10 Apr 15 Apr 20 Apr 25 Apr 30

0

10

20

30

40

idate

01.04.2015 − 30.04.2015

mm

May 05 May 10 May 15 May 20 May 25 May 30

0

10

20

30

40

idate

01.05.2015 − 31.05.2015

mm

Min Mean Max Std N

synop: 06 0 5.3 41.5 9 42

AM25: 00+30 0 2.9 42.4 6.9 90

Hirlam8: 00+30 0 2.7 19.1 4.2 92

ECMWF: 00+30 0 3 38.4 5.9 92

ME SDE RMSE MAE Max.abs.err. N

AM25 − synop 0.6 3.5 3.6 2.3 11.4 40

Hirlam8 − synop 0 5.9 5.9 3.3 25.6 42

ECMWF − synop 0.5 5 5.1 2.7 19.9 42

01.03.2015 − 31.05.2015

NELAUG

197