Performance Validation of Pending Suomi -NPP Operational Sounding Retrievals
1
Tony Reale 1 , Bomin Sun 2 , Michael Pettey 2 , Frank Tilley 2 , Charles Brown 2 , Nick Nalli 2 , Antonia Gambacorta 2 , Dave Tobin 3 and Chris Barnet 4 (1) NOAA Center for Satellite Applications and Research (STAR), College Park, Md., (2) I.M. Systems Group, Inc., (3) Space Science and Engineering Center, Madison, Wi., (4) Science and technology Corp., Columbia, Md. Performance Validation of Pending Suomi-NPP Operational Sounding Retrievals Poster #W54, NOAA 2013 Satellite Conference for Direct Readout, GOES/POES and GOES-R/JPSS Users, 8-12 April, NCWCP, College Park , Md (Corresponding Author: [email protected]) INTRODUCTION RESULTS The NOAA Products Validation System (NPROVS) has been operated at the NOAA Center for satellite Applications and Research (STAR) since April 2008. NPROVS provides centralized processing of operational conventional radiosondes (RAOB) and derived atmospheric sounding products from polar, geostationary and GPSRO environmental satellite platforms and is a key component of the Joint Polar Satellite System (JPSS) Cross-track Infrared (CrIS) and Microwave Sounder Suite (CrIMSS) Environmental Data Record (EDR) Cal/Val plan. A schematic diagram of NPROVS and the operational satellite product systems routinely accessed is shown below: REFERENCE OBSERVATIONS RAOB reports are from the WMO operational global network but are accessed by NPROVS after their assimilation into the NOAA Global Forecast System (GFS). Each report level includes a quality mark for temperature and moisture (Tdew) along with the “exactly” collocated GFS 6-hour forecast. Corresponding NOAA Climate Forecast System Re-analysis (CFSR) and associated background are appended retrospectively. The NPROVS collocation strategy for a given RAOB is to select the single, closest satellite sounding from each of the following: Advanced TIROS Operational Vertical Sounder (ATOVS) • NOAA-18, 19, MetOp-A, MetOp-B; AMSU and HIRS Microwave Integrated Retrieval System (MIRS) • NOAA-18, 19, MetOp-A, Suomi-NPP*, MetOp-B; AMSU and MHS, ATMS* • Defense Meteorological Satellite Program (DMSP) F-16; SSMIS Geostationary (GOES) • GOES 11 and 13; Infra-red Sounder Atmospheric InfraRed Sounder (AIRS, version 5) • NASA-Earth Orbiting Satellite (EOS) Aqua; AIRS and AMSU Infrared Atmospheric Sounding Interferometer (IASI) NOAA • MetOp-A,MetOp-B; IASI and ATMS Infrared Atmospheric Sounding Interferometer (IASI) EUMETSAT • MetOp-A, ; MetOp-B; IASI and ATMS Constellation Observing System for Meteorology Ionosphere and Climate (COSMIC) UCAR (version1, nrt) • Formosat-3; GPSRO Cross-track Infrared (CrIS) and Microwave (AMTS) Sounder Suite (CrIMSS) 1) Interface Data Processing Segment (IDPS … version 6.6) 2) NOAA Unique CrIS/ATMS Processing System (NUCAPS) • Suomi-NPP; CrIS and ATMS NPROVS includes an extensive analytical interface (EDGE) providing multiple options for interrogating the collocation datasets and satellite orbital data. Please visit the NPROVS web site for more details including options for downloading datasets and graphical application (JAVA) applets. http://www.star.nesdis.noaa.gov/smcd/opdb/poes/NPROVS.php Satellites and Systems highlighted in ”yellow” are in the process of being implemented into Operations. These include the IDPS, NUCAPS and MiRS products from Suomi-NPP presented in the RESULTS section. NPROVS is designed to access and monitor product performance from operational satellite data streams. During operational bring-up the projected operational data-streams may not yet contain the latest scientific software versions, currently the case for IDPS. Activity is underway at STAR to integrate observations from the evolving Global Climate Observing System (GCOS) Reference Upper Air Network (above) and dedicated (synchronized to Suomi-NPP overpass) RAOBS (below) into NPROVS (or NPROVS+). RESULTS (cont) www.GRUAN.org This includes planned “Site Atmospheric State Best Estimates” which combine available reference RAOB and ancillary (radiometer, lidar …) measurements, and NOAA Aerosols and Ocean Science Expeditions (AEROSE) providing valuable dedicated validation over remote ocean. PDISP NARCS ODS NARCS provides long term validation of legacy products NARCS takes full advantage of high samples compiled over time to monitor seasonal and climate scales Shorter term collocation datasets provide more detailed analysis on inter-product differences ranging from weeks to individual cases on any given day (PDISP) Following this theme we now look at a recent example of shorter term “operational” monitoring for a recent upgrade of CrIMSS IDPS from Mx6.3 to Mx6.6 IR+MW Mx6.3 101lev IR+MW mX6.6 101lev IR+MW mX6.3 30 layer IR+MW mX6.6 30 layer Validating H20 vapor fraction introduces concerns given that “weighting” of statistics based on H20 vapor content as done in past can skew the perceived performance (i.e. vs spec) So, at the end of the day, recent comparisons of Suomi-NPP EDR’s from IDPS, NUCAPS and MiRS using NPROVS … (44%) (85%) NUCAPS and IDPS Pass qc NUCAPS and IDPS pass (44%) (34%) NUCAPS and IDPS Pass qc (IR+MW) NUCAPS and IDPS pass (IR+MW) IDPS pass qc MW only Sea IDPS pass MW only Sea … work continues to better utilize respective qc, terrain and cloudiness parameters for more consistent inter-comparisons A key GRUAN principle is replacing the concept of providing a “true value” and “error” for a given measurement with that of providing a “range of values” and “uncertainty”. A key GRUAN principle is replacing the concept of a “true value” and “error” for a given measurement with that of providing a “range of values” and “uncertainty”. “k” profiles provide an added dimension to validation, in this case in the context of the reported GRUAN RAOB RH uncertainty (u 1 ). Efforts to include uncertainty (u 2 ) for satellite EDR pending … REFERENCE: Reale, A., B. Sun, F. Tilley, and M. Pettey (2012), NOAA Products Validation System (NPROVS), J. Atmos. Oceanic. Tech., 29, 629-645. 15 q_tru^2) q_tru^2) q_tru^2) IASI EU QC Product Yield Much Lower … Total / QC All w/o Poor Mx6.3 101lev All w/o Poor Mx6.6 101lev IR+MW Mx6.6 IR+MW Mx6.6 TEMPERATURE H2O Vapor Fraction
description
Performance Validation of Pending Suomi -NPP Operational Sounding Retrievals. RESULTS (cont). INTRODUCTION. RESULTS. - PowerPoint PPT Presentation
Transcript of Performance Validation of Pending Suomi -NPP Operational Sounding Retrievals
Tony Reale1, Bomin Sun2, Michael Pettey2, Frank Tilley2, Charles Brown2, Nick Nalli2 , Antonia Gambacorta2, Dave Tobin3 and Chris Barnet4
(1) NOAA Center for Satellite Applications and Research (STAR), College Park, Md., (2) I.M. Systems Group, Inc., (3) Space Science and Engineering Center, Madison, Wi., (4) Science and technology Corp., Columbia, Md.
Performance Validation of Pending Suomi-NPP Operational Sounding Retrievals
Poster #W54, NOAA 2013 Satellite Conference for Direct Readout, GOES/POES and GOES-R/JPSS Users, 8-12 April, NCWCP, College Park , Md (Corresponding Author: [email protected])
INTRODUCTION RESULTS
The NOAA Products Validation System (NPROVS) has been operated at the NOAA Center for satellite Applications and Research (STAR) since April 2008. NPROVS provides centralized processing of operational conventional radiosondes (RAOB) and derived atmospheric sounding products from polar, geostationary and GPSRO environmental satellite platforms and is a key component of the Joint Polar Satellite System (JPSS) Cross-track Infrared (CrIS) and Microwave Sounder Suite (CrIMSS) Environmental Data Record (EDR) Cal/Val plan. A schematic diagram of NPROVS and the operational satellite product systems routinely accessed is shown below:
REFERENCE OBSERVATIONS
RAOB reports are from the WMO operational global network but are accessed by NPROVS after their assimilation into the NOAA Global Forecast System (GFS). Each report level includes a quality mark for temperature and moisture (Tdew) along with the “exactly” collocated GFS 6-hour forecast. Corresponding NOAA Climate Forecast System Re-analysis (CFSR) and associated background are appended retrospectively.
The NPROVS collocation strategy for a given RAOB is to select the single, closest satellite sounding from each of the following:Advanced TIROS Operational Vertical Sounder (ATOVS)• NOAA-18, 19, MetOp-A, MetOp-B; AMSU and HIRS Microwave Integrated Retrieval System (MIRS)• NOAA-18, 19, MetOp-A, Suomi-NPP*, MetOp-B; AMSU and MHS, ATMS*• Defense Meteorological Satellite Program (DMSP) F-16; SSMISGeostationary (GOES) • GOES 11 and 13; Infra-red SounderAtmospheric InfraRed Sounder (AIRS, version 5)• NASA-Earth Orbiting Satellite (EOS) Aqua; AIRS and AMSUInfrared Atmospheric Sounding Interferometer (IASI) NOAA • MetOp-A,MetOp-B; IASI and ATMS Infrared Atmospheric Sounding Interferometer (IASI) EUMETSAT • MetOp-A, ; MetOp-B; IASI and ATMSConstellation Observing System for Meteorology Ionosphere and
Climate (COSMIC) UCAR (version1, nrt) • Formosat-3; GPSRO Cross-track Infrared (CrIS) and Microwave (AMTS) Sounder Suite
(CrIMSS) 1) Interface Data Processing Segment (IDPS … version 6.6) 2) NOAA Unique CrIS/ATMS Processing System (NUCAPS) • Suomi-NPP; CrIS and ATMS
NPROVS includes an extensive analytical interface (EDGE) providing multiple options for interrogating the collocation datasets and satellite orbital data.
Please visit the NPROVS web site for more details including options for downloading datasets and graphical application (JAVA) applets. http://www.star.nesdis.noaa.gov/smcd/opdb/poes/NPROVS.php
Satellites and Systems highlighted in ”yellow” are in the process of being implemented into Operations. These include the IDPS, NUCAPS and MiRS products from Suomi-NPP presented in the RESULTS section. NPROVS is designed to access and monitor product performance from operational satellite data streams. During operational bring-up the projected operational data-streams may not yet contain the latest scientific software versions, currently the case for IDPS.
Activity is underway at STAR to integrate observations from the evolving Global Climate Observing System (GCOS) Reference Upper Air Network (above) and dedicated (synchronized to Suomi-NPP overpass) RAOBS (below) into NPROVS (or NPROVS+).
RESULTS (cont)
www.GRUAN.org
This includes planned “Site Atmospheric State Best Estimates” which combine available reference RAOB and ancillary (radiometer, lidar …) measurements, and NOAA Aerosols and Ocean Science Expeditions (AEROSE) providing valuable dedicated validation over remote ocean.
PDISP
NARCS
ODS
NARCS provides long term validation of legacy products
NARCS takes full advantage of high samples compiled over time to monitor seasonal and climate scales
Shorter term collocation datasets provide more detailed analysis on inter-product differences ranging from weeks
to individual cases on any given day (PDISP)
Following this theme we now look at a recent example of shorter term “operational” monitoring for a recent
upgrade of CrIMSS IDPS from Mx6.3 to Mx6.6
IR+MWMx6.3
101lev
IR+MWmX6.6
101lev
IR+MWmX6.3
30 layer
IR+MWmX6.6
30 layer
Validating H20 vapor fraction introduces concerns given that “weighting” of statistics based on H20 vapor
content as done in past can skew the perceived performance (i.e. vs spec)
So, at the end of the day, recent comparisons of Suomi-NPP EDR’s from IDPS, NUCAPS and MiRS
using NPROVS …
(44%) (85%)NUCAPS and IDPS
Pass qc
NUCAPS and IDPS pass
(44%) (34%)NUCAPS and IDPS
Pass qc(IR+MW)
NUCAPS and IDPS pass
(IR+MW)
IDPS pass qcMW only
Sea
IDPS passMW only
Sea
… work continues to better utilize respective qc, terrain and cloudiness parameters for more consistent inter-comparisons
A key GRUAN principle is replacing the concept of providing a “true value” and “error” for a given measurement with that of providing a “range of values” and “uncertainty”.
A key GRUAN principle is replacing the concept of a “true value” and “error” for a given measurement with that of providing a “range of values” and “uncertainty”.
“k” profiles provide an added dimension to validation, in this case in the context of the reported GRUAN RAOB RH uncertainty (u1). Efforts to include uncertainty (u2 ) for satellite EDR pending …
REFERENCE: Reale, A., B. Sun, F. Tilley, and M. Pettey (2012), NOAA Products Validation System (NPROVS), J. Atmos. Oceanic. Tech., 29, 629-645. 15
q_tru^2)
q_tru^2)
q_tru^2)
IASI EU QC Product Yield Much Lower …
Total / QC
Allw/o PoorMx6.3
101lev
Allw/o PoorMx6.6
101lev
IR+MWMx6.6
IR+MWMx6.6
TEMPERATURE H2O Vapor Fraction
