Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with...

27
ECMWF Spatial and inter-channel observation error characteristics for AMSU-A and IASI and applications in the ECMWF system Niels Bormann, Andrew Collard, Peter Bauer

Transcript of Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with...

Page 1: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Spatial and inter-channel observation error characteristics

for AMSU-A and IASI and applications in the ECMWF system

Niels

Bormann, Andrew Collard, Peter Bauer

Page 2: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Outline

1)

Estimation of observation errors•

AMSU-A•

IASI2)

Applications in 4DVAR3)

Summary

Page 3: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Outline

1)

Estimation of observation errors•

AMSU-A•

IASI2)

Applications in 4DVAR3)

Summary

Page 4: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

BackgroundCurrent observation errors (O+F) for radiances are specified largely in an ad-hoc way, loosely based on FG-departures and other considerations.

Any error correlations are neglected (spatial/inter-channel).

Likely sources of error correlations:Radiative transfer (spectroscopy, assumed gas concentrations,…)

Representativeness

Instrument design; calibration practices; etc

Quality control

Thinning/error inflation is used to reduce the impact of spatial error correlations; choices largely based on intuition.

Observation error correlations could be accounted for in the assimilation.

Page 5: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Methods

Estimating observation errors is not straightforward.

Estimation methods rely on a range of (questionable) assumptions or have other problems.

Use three methods, based on bias-corrected assimilated FG/AN-departures:

Hollingsworth/Lönnberg (Hollingsworth & Lönnberg 1986)

“Background error method”

Desroziers diagnostic (Desroziers et al. 2005)

Used for ATOVS instruments, AIRS, and IASI; see Bormann and Bauer (2010) and Bormann et al. (2010), both QJ.

Page 6: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Methods: “Background error method”Based on covariances calculated from pairs of FG departures, binned by separation distance.Subtract a scaled version of the assumed background error, mapped to radiance space.

Scaling such that FG-departure covariances match scaled assumed background errors for separations > threshold (scaling ≤ 1).Relies on adequate background error covariance; problems for Tskin error.

Assumed background error, mapped to radiance space

Scaled assumed background error, mapped to radiance space

Difference to FG-departure covariance → obs. error

Page 7: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

N-18 AMSU-A: Estimated observation errors (σO

)

• Good agreement between different methods.

Estimated errors close to instrument noise –

RT error largely taken out by bias correction?

• Estimated errors lower than errors currently used in the assimilation (~half).

Page 8: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

AMSU-A: Spatial observation error correlations by separation distance

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1.00.80.60.40.20.0

r

1210

86420

1.00.80.60.40.20.0

r

Num

ber [

Milli

ons]

Ch 5

Ch 9

Ch 6 Ch 7 Ch 8

Ch 10 Ch 11 Ch 12

Ch 13 Ch 14 Background error method

Desroziers

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

0 400 800 1200Distance [km]

Page 9: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

AMSU-A: Inter-channel observation error correlations

Hollingsworth/Lönnberg

Background error method Desroziers

5 6 7 8 9 10 11 12 13 14Channel number Channel number Channel number

141312111098765

Cha

nnel

num

ber

1.0

0.75

0.5

0.25

0.0

-0.255 6 7 8 9 10 11 12 13 14 5 6 7 8 9 10 11 12 13 14

141312111098765

141312111098765

Page 10: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

IASI: Observation errors (σO

)

Temperature soundingLW

Window WV

Page 11: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

IASI: Spatial error correlations

Temperature soundingLW

Window WV

Page 12: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

IASI: Inter-channel error correlations

Desroziers

Background errormethod

Hollingsworth/Lönnberg

Page 13: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

IASI: Inter-channel error correlations(Desroziers)

Page 14: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Outline

1)

Estimation of observation errors•

AMSU-A•

IASI2)

Applications in 4DVAR3)

Summary

Page 15: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Forecast impact: Less thinning for

AMSU-A

Forecast day

NH, Z 500 hPa

SH, Z 500 hPa

CTL: 125 km thinning for AMSU-AEXP: 62.5 km thinning for AMSU-A

T511 experiments:NH Winter: Dec 2008/Jan 2009 NH Summer: June/July 2009

Impact larger for summer hemisphere•

Some degradation for Z in the stratosphere for the winter hemisphere

Half thinning bad

Half thinning good

Normalised RMSE differences (123 cases):

Page 16: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Modifying IASI observation errors: Forecast impactExperiments with modified IASI observation errors (July/August 2009):• CTL: Old

(diagonal) observation errors• EXP1: Updated diagonal observation errors for T-sounding channels (factor 2.5)• EXP2: As EXP1, but with error correlations for all channelsNormalised difference in the RMSE, EXP1 vs

CTL, (54 cases):EXP1 worse

EXP1 better

NH, Z 1000 hPa

NH, Z 500 hPa

SH, Z 1000 hPa

SH, Z 500 hPa

Page 17: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Modifying IASI observation errors: Forecast impactExperiments with modified IASI observation errors (July/August 2009):• CTL: Old

(diagonal) observation errors• EXP1: Updated diagonal observation errors for T-sounding channels (factor 2.5)• EXP2: As EXP1, but with error correlations for all channelsNormalised difference in the RMSE, EXP2 vs

CTL, (54 cases):EXP2 worse

EXP2 better

NH, Z 1000 hPa

NH, Z 500 hPa

SH, Z 1000 hPa

SH, Z 500 hPa

Page 18: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Outline

1)

Estimation of observation errors•

AMSU-A•

IASI2)

Applications in 4DVAR3)

Summary

Page 19: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

SummarySmall observation error correlations (<0.2) for surface-insensitive temperature-sounding channels at current thinning scales.Some inter-channel error correlations for:

IASI water-vapour channelsIASI long-wave window channelsNeighbouring IASI channels (apodisation)

Some spatial error correlations for:Water-vapour channels at small scales

Role of RT errors and bias correction?

See Bormann and Bauer (2010) and Bormann et al. (2010), soon in QJ.

Application in 4DVAR:Improved forecast impact from assimilating AMSU-A more densely.Encouraging results from taking IASI inter-channel observation error correlations into account, but scaling of errors required.

Page 20: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Modifying IASI observation errors•

Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009).

• Standard deviations of Obs-FG, normalised to 1 for no-IASI experiment:

Page 21: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Modifying IASI observation errors•

Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009).

• Standard deviations of Obs-FG, normalised to 1 for no-IASI experiment:

Horizontal lines: Values using old (diagonal) observation errors.

Page 22: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Modifying IASI observation errors•

Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009).

• Standard deviations of Obs-FG, normalised to 1 for no-IASI experiment:

Horizontal lines: Values using old (diagonal) observation errors.

Page 23: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

IASI inter-channel error correlations

Eigenvalues

of the error correlation matrix:

Page 24: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Obs-FG departure(all channels considered cloud-free)

Temperature increment [K]

Humidity increment [g/Kg]

Mod

el le

vel

Mod

el le

vel

T

Q

Without correlationWith correlation

Without correlationWith correlation

Single IASI spectrum assimilation experiments (I)

Page 25: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Single IASI spectrum assimilation experiments (II)

Temperature increment [K]

Humidity increment [g/Kg]

Mod

el le

vel

Mod

el le

vel

T

Q

Without correlationWith correlation

Obs-FG departure(all channels considered cloud-free)

Without correlationWith correlation

Page 26: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Single IASI spectrum assimilation experiments (III)

Temperature increment [K]

Humidity increment [g/Kg]

Mod

el le

vel

Mod

el le

vel

T

Q

Without correlationWith correlation

Obs-FG departure Without correlationWith correlation

Page 27: Observation error characteristics · Use Desroziers-estimated observation errors in 4DVAR, with correlations, and scaling factor (July/August 2009). • Standard deviations of Obs-FG,

ECMWF

Single IASI spectrum assimilation experiments (IV)

Temperature increment [K]

Humidity increment [g/Kg]

Mod

el le

vel

Mod

el le

vel

T

Q

Without correlationWith correlation

Obs-FG departure(all channels consideredcloud-free)

Without correlationWith correlation