TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for...

16
TIGGE Data Archive and Access at TIGGE Data Archive and Access at NCAR NCAR November 2008 November 2008 Steven Worley Steven Worley National Center for Atmospheric Research National Center for Atmospheric Research Boulder, Colorado, U.S.A. Boulder, Colorado, U.S.A.

Transcript of TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for...

Page 1: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

TIGGE Data Archive and Access at TIGGE Data Archive and Access at NCARNCAR

November 2008November 2008

Steven WorleySteven Worley

National Center for Atmospheric ResearchNational Center for Atmospheric Research

Boulder, Colorado, U.S.A.Boulder, Colorado, U.S.A.

Page 2: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Topic OutlineTopic Outline

Project DefinitionProject Definition Archive SummaryArchive Summary Data DescriptionData Description Provider SummaryProvider Summary NCAR’s portal and accessNCAR’s portal and access

Page 3: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Project OutlineProject Outline

TIGGE, the THe Observing System Research and Predictability TIGGE, the THe Observing System Research and Predictability EXperiment (EXperiment (TTHORPEX) HORPEX) IInteractive nteractive GGrand rand GGlobal lobal EEnsemblensemble

WMO World Weather Research ProgrammeWMO World Weather Research Programme Goal, accelerate improvements in 1-day to 14-day high-Goal, accelerate improvements in 1-day to 14-day high-

impact weather forecastsimpact weather forecasts HowHow

– Enhanced international collaboration on ensemble predictionEnhanced international collaboration on ensemble prediction– New methods for combining ensembles from different sourcesNew methods for combining ensembles from different sources– Deeper understanding of forecast errorsDeeper understanding of forecast errors

PurposePurpose– Prototype for a future Global Interactive Forecast System (GIFS)Prototype for a future Global Interactive Forecast System (GIFS)

Page 4: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Phase I Archive CentersPhase I Archive Centers

Archive CentersArchive Centers NCARNCAR ECMWFECMWF China Meteorological Administration (CMA)China Meteorological Administration (CMA)

Archive Centers build identical archives, i.e. all the Archive Centers build identical archives, i.e. all the data.data.

Page 5: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

TIGGE Archive Centers and Data Providers

Archive Centre

Current Data Provider

NCAR NCEP

CMC

UKMO

ECMWFMeteoFrance

JMAKMA

CMA

BoMCPTEC

IDD/LDM

HTTP

FTP

IDD/LDM

Internet Data Distribution / Local Data Manager

Commodity internet application to send and receive data

Page 6: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Brief Data DescriptionBrief Data Description

Global Ensemble Forecasts

Five parameters on eight pressure levels• Z, Q, T, U, V• 1000, 925, 850, 700, 500, 300, 250, 200 hPa

Z at 50 hPa

Potential Vorticity on 320 K Potential Temperature Surface (θ)

θ, U, V on 2 potential vorticity surface

28 Surface/Single level parameters

Page 7: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Summary of Data Providers, March ‘08Summary of Data Providers, March ‘08

Center Conforming Parameters

Ens. Members

Model Res.

Fcst Length

Fcsts/ Day

GB/ Day

Fields/ Day

Files/ Day

ECMWF (ecmf)

70/73 51 N200 (Reduced Gaussian)

10 day 2 115 289,734 328

ECMWF (ecmf)

70/73 51 N128 (Reduced Gaussian)

10-15 day

2 24 138,978 160

UKMO (egrr)

70/73 24 1.25 x 0.83 Deg 15 day 2 21 175,680 488

JMA (rjtd)

61/73 51 1.25 x 1.25 Deg 9 day 1 7 113,192 74

NCEP (kwbc)

59/73 21 1.00 x 1.00 Deg 16 day 4 10 316,596 1040

CMA (babj)

60/73 15 0.56 x 0.56 Deg 10 day 2 28 72,510 82

CMC (cwao)

56/73 21 1.00 x 1.00 Deg 16 day 2 8 163,674 260

BOM (ammc)

55/73 33 1.50 x 1.50 Deg 10 day 2 8 147,972 164

MF (lfpw)

62/73 11 1.50 x 1.50 Deg

2.5 day

1 .15 7,558 33

KMA (rksl)

46/73 17 1.00 x 1.00 Deg 10 day 2 5 64,124 164

CPTEC (sbsj)

55/73 15 1.00 x 1.00 Deg 15 day 2 14 97,084 244

Total 22 240 1,587,102 3,037

Page 8: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Variable LvL ECWF UKMO JMA NCEP CMA CMC BOM MetF KMA CPTC

Geopotential Z PL

Specific H PL

T PL

U-velocity PL

V-velocity PL

Potential Vor PT

Potential T PV

U-velocity PV

V-Velocity PV

U 10m SL

V 10m SL

CAPE SL

Conv. Inhib. SL

Land-sea SL

Mean SLP SL

Orog. SL

Skin T SL

Snow D. H20 SL

Snow F. H20 SL

TIGGE Archive Completeness, 02/2008

PL = Pressure Level, PT = 320K Theta Level, SL = Single/Surface Level

Page 9: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Variable LvL ECWF UKMO JMA NCEP CMA CMC BOM MetF KMA CPTC

Soil Moist. SL

Soil T SL

Sunshine D. SL

Surf. DPT SL

Surf. ATmax SL

Surf. ATmin SL

Surf. AT SL

Surf. P SL

LW Rad. Out SL

LH flux SL

Net Rad SL

Net Therm. Rad SL

Sensible Rad. SL

Cloud Cov SL

Column Water SL

Precipitation SL

Wilt. Point SL

Field Cap. SL

TIGGE Archive Completeness, 02/2008

PL = Pressure Level, PT = 320K Theta Level, SL = Single/Surface Level

Page 10: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

The Data Management ChallengesThe Data Management Challenges

Anomalies between centersAnomalies between centers Native horizontal resolutionNative horizontal resolution Number of ensemble membersNumber of ensemble members Number of forecast initialization times (1, 2, 4x daily)Number of forecast initialization times (1, 2, 4x daily) Forecast increment time periodForecast increment time period Forecast lengthForecast length Number of fields providedNumber of fields provided Internal file compression (e.g. jpg) was not specifiedInternal file compression (e.g. jpg) was not specified

Influence on ResearchInfluence on Research

User interface must inform users - commonalities constrain User interface must inform users - commonalities constrain researchresearch

Page 11: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

NCAR TIGGE Portal NCAR TIGGE Portal

Address: Address: http://tigge.ucar.edu

Main FeaturesMain Features– Registration and LoginRegistration and Login– Get DataGet Data– User ToolsUser Tools– Documentation and LinkagesDocumentation and Linkages– Technical and Community Supported HelpTechnical and Community Supported Help

Page 12: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Dates

Center

File Type

Forecast Time

Forecast Duration

Page 13: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Get Forecast Data

NCAR online file archive

• Selection options•Center(s)•Date•File type (sl, pl, etc)•Initialization time•Forecast length

Download Options• Point and click using browser, one file at a time• Script to run on local machine

•User and password encrypted ‘wget’ commands• background process to access all files

User customized files

• Selection options•Same as for files, plus•Parameter•Regridding•Spatial subsets•Formats, GRIB2, netCDF

Delayed ModeReal Time

Two User Interfaces

Page 14: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Tropical Cyclone Track DataTropical Cyclone Track Data

Direct Download Only, <CXML> format•Simple directory system, center/year/month•Web address, dss.ucar.edu/datasets/ds330.3

Update Frequency

• 12 hours

Size

• 6GB

Page 15: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

Public AnnouncementPublic Announcement

EOS, Transactions, American EOS, Transactions, American Geophysical Union, Vol. 89, Number 36, Geophysical Union, Vol. 89, Number 36, September 2, 2008 September 2, 2008 – Title: Improving High-Impact Weather Title: Improving High-Impact Weather

ForecastsForecasts– Included an online supplement Included an online supplement

Page 16: TIGGE Data Archive and Access at NCAR November 2008 November 2008 Steven Worley National Center for Atmospheric Research Boulder, Colorado, U.S.A.

ENDEND

Steven WorleySteven Worley

[email protected]@ucar.edu