WMO Information System : WIS and a Pilot Project from...

24
11Dec. – 13 Dec. 2006, 3 rd Grid@Aisa & GFK2006 International Joint Workshop KMA Meteorology e Meteorology e - - Science Effort in Korea Science Effort in Korea WMO Information WMO Information System System : WIS : WIS and and a Pilot Project from CAgM Dec. 13, 2006 Dong-Il Lee & Byong-Lyol Lee Korea Meteorological Administration Korea Meteorological Administration Status & Perspectives

Transcript of WMO Information System : WIS and a Pilot Project from...

Page 1: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Meteorology eMeteorology e--Science Effort in KoreaScience Effort in Korea

WMO Information WMO Information SystemSystem : WIS: WIS

and and a Pilot Project from CAgM

Dec. 13, 2006

Dong-Il Lee & Byong-Lyol Lee

Korea Meteorological AdministrationKorea Meteorological Administration

Status & Perspectives

Page 2: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

• Implementation Strategies– Metadata/Ontology– Web service/Grid service

• Current Implementations for WIS– CAgM/WIS– WIS/KMA

Key ContentsKey Contents

Page 3: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

GEO Initiatives & Cyber Infrastructure

Page 4: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

WIS implementationsWIS implementations(CAgM/WIS)(CAgM/WIS)

Page 5: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

WIS/GISC infrastructure(WMO Information System)SIMDAT(EU)SIMDAT(EU)

Page 6: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

CAgM MetaData Management

Prototypes of Extended WMO Metadata Core Profile Keywords

Page 7: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMAHierarchy of weather elements RDF/OWL presentation

WAMIS

Page 8: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Prototype of Ontology using extended Keywords

WAMIS

Page 9: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Web & Workflow

Page 10: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

• Dedicated (Virtual) DCPC/GISC to Agro-

/Applied Meteorology– To take care of non-conventional and extra-

disciplinary data/products(flux, vegetation, soil, forestry, water cycle, etc.)

– To establish a bridge toward GEOSS in information sharing

• Resource sharing technolgy– Servers for NWPs, application models, GIS tools, etc.– Computing GRID is being tested

Requirements from CAgMRequirements from CAgM

Page 11: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

ImplementationsImplementations(WIS/KMA)(WIS/KMA)

Page 12: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

KMA Efforts to OPENDAP with Grid (I)

agent

SAM File Pool

datasetdataset

Page 13: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

KMA Efforts for WIS (II)

dataset

Page 14: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

SIMDATPortal

AMBER

MM5

① Invoke Cluster Resources

By WorkFlow Model

② Call script to reportMeteo modeling

Storage

③ Save resultTo Report File(server side)

Meta catalog

VMCnode

View ReportsOGSA-DAIService

KMA Efforts for WIS (III)

Page 15: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

agentSAN

CTL,IDX for Grib

MetadataExtractor

SIMDATData Repository

UNIDARTMetadataTimeseries/GTS

Ensemble /GDPSWAMIS

VMCNODE(GISC)

WEBPortal

Computing Service

WAMIS Workflow

GrADS Visualization Service

FTP PUSH Service

WorkflowEngineComputing

Resource

KMA Efforts for WIS (IV)

Page 16: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Future KMA Efforts for WIS

GISC

DCPC

GDS & LASGDS & LASOPENDAP

Agent metadatametadata

metadata

Legacy dataset

Legacy dataset

GISC

Integrated PORTAL

Page 17: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

DCPC

Synchronize#1

MySQLDB

MySQLDB

② New Service

③ Find New Services

④ Figure outNew Servicesinformation

① Scheduling for synchronize

periodically

⑥ Insert (update) recordsFor new services ⑤ Return

New serviceinformation

Implemented GISC Functions (1)

Portal GISC

DCPC Config XML Metadata

1. Synchronize between GISC and DCPC for new service

UNIDART UNIDART

Page 18: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

2. Synchronize between GISC and DCPC for new metadata

DCPC

Synchronize#1

MySQLDB

MySQLDB

Portal GISC

DCPC Config XML Metadata

② New Metadata with new Service ID

③ Search FragmentOn metadata Directory

With Service ID ④ Read MetadataMatched with

Fragment

① Scheduling for synchronize

periodically

⑥ Insert (update) recordsFor new metadata contents

⑤ Return New Metadata

Implemented GISC Functions [2]

Page 19: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Wee

Service

3. Harvesting using Wee Service - OAI

DCPC

MySQLDB

MySQLDB

Portal GISC

XML Metadata

② Make/Send Harvesting msg

③ Search FragmentWith Service ID

Save in DB④ Read Fragment

Metadata

① Scheduling for synchronize

periodically

⑥ Insert (update) recordsFor Fragment contents

⑤ Return Fragment Metadata

Implemented GISC Functions [3]

Page 20: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Staging Directoryof Portal

Staging Directoryof Portal

OGSA-DAI

② Call OGSA-DAIWith Service class info

And Retrieve condition values

③ Make RequestXML Data

⑤ Return Data

① Request DataUsing conditionsdefined By client

①-1 Save Timestamp IDOn Hashmap List

⑥ SendStatus / Data

⑦ ReturnRequest Status /

Return Data

⑧ If Status is Completed, then

save Data returned by OGSA-DAI

④ Retrieve / MakeXML Data

Portal GISC

Data RepositoryActivity

Storage ForMeteo Data

4. Data Requesting OGSA-DAI service: Instant XML Result Service

Implemented GISC Functions [4]

Page 21: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

5. Data Requesting using OGSA-DAI service: PUSH Service

OGSA-DAI

② Call OGSA-DAIWith Service class info

And Retrieve condition values

Data Transfer Service

③ Make RequestXML Data

⑤ CallbackStatus

① Request Enb/GDPS DataUsing conditionsdefined By client

①-1 Save Timestamp IDOn Hashmap List

⑥ SendStatus

StorageFor

Meteo Data

TargetFTP Server

⑦ ReturnRequest Status

④-1 Transferring XML fileto target FTP Server

④ RetrieveXML Data

Portal GISC

Implemented GISC Functions [5]

Page 22: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

6. WAMIS Service Execution using WorkFlow GUI component

AMBER

MM5

① Invoke Cluster Resources

By WorkFlow Model

② Call script to reportMeteo modeling

Report File

③ Save resultTo Report File(server side)

Connect to serverBy samba service

Portal

Implemented GISC Functions – WAMIS

Page 23: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

<KMA UNIDART>

OGSA-DAI WSRF

Globus Toolkit

Tomcat

ORACLE MetaDB

210.107.255.14

210.107.255.100

DB

<UNIDART Portal>

OC4J Server

<ECMWF SIMDAT Portal>PortalVMCDataRepositoryMySQL

<KMA Climate DB>

MySQL(SYKO60)

FilePool(GTS, Grib)

<KMA SIMDAT & Portal>

Portal

VMC

DataRepository(using UNIDART)

MySQL

<KMA WAMIS NODE>

MM5 operation

Grid model output Tool

<DWD UNIDART>

OGSA-DAI WSRF

Globus Toolkit

Tomcat

DMZ

Demonstration site

KMA DMZ

DWD

ECMWF

AMBER on Windows

Demo – System Architecture

Page 24: WMO Information System : WIS and a Pilot Project from CAgMgridatasia.ercim.eu/images/seoul/pdf/Dong-IlLee.pdf · 5. Data Requesting using OGSA-DAI service: PUSH Service OGSA-DAI ②Call

11Dec. – 13 Dec. 2006, 3rd Grid@Aisa & GFK2006 International Joint Workshop KMA

Thank you!Thank you!